.jpg&w=1536&q=75)
LLM Ops - Large Language Models in Production
10.0
(6 ratings)
4 Weeks
·Cohort-based Course
Future-proof your career with AI engineering. Design, assemble, and operate production LLM apps with industry-standard tools.
Hosted by
Dr. Greg Loughnane, Chris "The LLM Wizard 🪄" Alexiuk , and Ali Kadhim
LLM Educators @ AI Makerspace and @ FourthBrain (Funded by Andrew Ng's AI Fund)
Course overview
Become the AI Engineer that every company needs
Data science and ML skills that were relevant just a few years ago are being outpaced by AI. It is now possible to build what used to take months in a single day!
This course is designed to help you think at the right level of abstraction about AI, and to write code that will help you prototype and ship production LLM applications at the leading edge.
Who is this course for
01
Advanced developers with an understanding of fundamental ML concepts and the product development process
02
Experienced data scientists or machine learning engineers who want to build production LLM applications
03
Software engineers who want to get up to speed on Generative AI and explore new career opportunities
What you’ll get out of this course
Build complex apps with LLM Ops frameworks including LangChain and LlamaIndex
Understand LLM product development methods, from prompting to retrieval and beyond
Build, deploy, evaluate, and operate your own end-to-end production RAG systems
Work with other talented builders to bring your LLM project or startup idea to life
LLM Ops - Large Language Models in Production
Prerequisite
Course syllabus
01
🧑💻 Building LLM Applications in Pure Python
- LLM Ops vs. MLOps vs. ML Engineering
- Build your first LLM Application with Chainlit and Hugging Face
- Build a Retrieval Augmented Generation (RAG) 101 with OpenAI API
- LLMOps Visibility with Weights and Biases
02
🔗 LangChain Powered RAG and Advanced Retrieval
- Intro to LangChain
- Prompt and embedding caching in RAG systems
- Build a RAG with LangChain, OpenAI, and Pinecone
- Evaluate RAGs for context and relevancy with RAGAS
- Improve RAG systems with advanced retrieval
03
🦙 Llama Week!
- Deploying Llama 2-powered RAG systems to production via Amazon SageMaker
- Intro to LlamaIndex
- Build a RAG with LlamaIndex, Llama 2, FAISS that combines retrieval of tabular and language data
- Index versioning with Weights and Biases
04
🕴️Agents, 🧑💻 Hackathon, and 🧑🏫 Demo Day!
- All things agents!
- LangChain vs. LlamaIndex
- LangSmith and the evolving LLM Ops landscape
- LLM Ops Hackathon!
- Demo Day!
- Graduation!
For all of the details on topics and tools covered each week, check out the detailed schedule below👇!
📅 Detailed Schedule!
Want to know exactly what the assignments will be, when, and what tools they will use?
Yup send me the deets ✌️
10.0
(6 ratings)
What people are saying
Todd Deshane
Pano Evangeliou
Martin Rodrigo Moreno Otalvaro
Rafael Arias Calles
Meet your instructional staff!
Dr. Greg Loughnane
Founder & CEO @ AI Makerspace
I've worked as an AI product manager, university professor, data science consultant, AI startup advisor, and ML researcher; TEDx & keynote speaker, lecturing since 2013.
From 2021-2023 I worked at FourthBrain (Backed by Andrew Ng's AI Fund) to build industry-leading online bootcamps in ML Engineering and ML Operations (MLOps):
🔗 Resources links: Deeplearning.ai demos, AI Makerspace demos, LinkedIn, Twitter, YouTube, Blog.
Chris "The LLM Wizard 🪄" Alexiuk
Head of LLMs @ AI Makerspace
I'm currently working as the Founding Machine Learning Engineer at Ox - but in my off time you can find me creating content for Machine Learning: either for the AI Makerspace, FourthBrain, or my YouTube Channel!
My motto is "Build, build, build!", and I'm excited to get building with all of you!
Ali Kadhim
LLM Consultant
I work with startup entrepreneurs to ideate, build, and deploy generative AI applications. Previously, I served as a product owner, machine learning lead, and MLOps instructor.
You can catch me in my off time building computers, woodworking projects, or building electronics.
🔗 Resources links: LinkedIn
Join an upcoming cohort
LLM Ops - Large Language Models in Production
LLMO3
$1,250 USD
Dates
Nov 29—Dec 23, 2023
Application Deadline
Nov 29, 2023
Course schedule
10+ hrs
Class!
Tuesdays & Thursdays, 4:00-6:00pm PT
- Nov 28th, 30th
- Dec 5th, Dec 7th
- Dec 12th, Dec 14th
- Dec 19th, Dec 21st
* All sessions will be recorded for your viewing pleasure!
Community Sessions
Mondays and Wednesdays
- Building Your Personal Generative AI Brand: Mondays @ 4:30 PM PT
- Community Build Sessions: Wednesdays @ Timing varies!
Office Hours
Mondays, Thursdays, and Fridays
- Greg Loughnane: Tuesdays @ 8 AM PT
- Ali Kadhim: Tuesdays @ 10 AM PT
- Chris Alexiuk: Fridays @ 3 PM PT
Programming Assignments
Each class period, we will get hands-on with Python coding homework, due each Monday.
LLM Ops Hackathon
Wednesday, Dec 20th from 11 AM - 5 PM PT
- 11-2 PT: Team formation, project ideation, storytelling workshop, system diagram presentation
- 2-5 PT: Build 🏗️, ship 🚢, and share 🚀 a RAG system with at least the following components: caching, evaluation, visibility
LLM Ops Demo Day
December 21 at 4:00 PM PT
- Open to the pubic - Friends, family, coworkers and bosses welcome!
Getting after it is better with like-minded builders
Hands-on coding, every class
We're here to teach concepts AND code. Never one or the other.
Next-Level Breakout Rooms
Grow your network. Build together. Feel the difference that expert facilitation makes.
Meet Your Accountabilibuddies
Join a community of doers, aimed in the same career direction as you; that is, towards LLM Ops.
Frequently Asked Questions
What happens if I can’t make a live session?
I work full-time, what is the expected time commitment?
What’s the refund policy?
What if I don't know Git and how to use GitHub?
What if I'm not yet proficient in Python and the foundations of Machine Learning?
Stay in the loop
Sign up to be the first to know about course updates.
Join an upcoming cohort
LLM Ops - Large Language Models in Production
LLMO3
$1,250 USD
Dates
Nov 29—Dec 23, 2023
Application Deadline
Nov 29, 2023