Hero image

LLM Ops - Large Language Models in Production

10.0

(6 ratings)

4 Weeks

Cohort-based Course

Future-proof your career with AI engineering. Design, assemble, and operate production LLM apps with industry-standard tools.

Hosted by

Dr. Greg Loughnane, Chris "The LLM Wizard 馃獎" Alexiuk , and Ali Kadhim

LLM Educators @ AI Makerspace and @ FourthBrain (Funded by Andrew Ng's AI Fund)

Course overview

Become the AI Engineer that every company needs

Data science and ML skills that were relevant just a few years ago are being outpaced by AI. It is now possible to build what used to take months in a single day!


This course is designed to help you think at the right level of abstraction about AI, and to write code that will help you prototype and ship production LLM applications at the leading edge.

Who is this course for

01

Advanced developers with an understanding of fundamental ML concepts and the product development process

02

Experienced data scientists or machine learning engineers who want to build production LLM applications

03

Software engineers who want to get up to speed on Generative AI and explore new career opportunities

What you鈥檒l get out of this course

Build complex apps with LLM Ops frameworks including LangChain and LlamaIndex


Understand LLM product development methods, from prompting to retrieval and beyond


Build, deploy, evaluate, and operate your own end-to-end production RAG systems


Work with other talented builders to bring your LLM project or startup idea to life

Prerequisite

Be able to leverage a standard Interactive Development Environment (IDE) for building LLM software

Tools include VS Code, UNIX terminal, Jupyter Notebooks, and Conda package management.


馃敆 Resource Links: Video, Code

Be able to programmatically access Open AI API as a developer

Including GPT 3.5, GPT 4, etc.


馃敆 Resource Links: Video, Code

Course syllabus

01

馃鈥嶐煉宦燘uilding LLM Applications in Pure Python

  • LLM Ops聽vs. MLOps vs. ML Engineering
  • Build your first LLM Application with Chainlit and Hugging Face
  • Build a Retrieval Augmented Generation (RAG) 101 with OpenAI API
  • LLMOps Visibility with Weights and Biases

02

馃敆聽LangChain Powered RAG and Advanced Retrieval

  • Intro to LangChain
  • Prompt and embedding caching in RAG systems
  • Build a RAG with LangChain, OpenAI, and Pinecone
  • Evaluate RAGs for context and relevancy with RAGAS
  • Improve RAG systems with advanced retrieval

03

馃聽Llama Week!

  • Deploying Llama 2-powered RAG systems to production via Amazon SageMaker
  • Intro to LlamaIndex
  • Build a RAG with LlamaIndex, Llama 2, FAISS that combines retrieval of tabular and language data
  • Index versioning with Weights and Biases

04

馃暣锔廇gents, 馃鈥嶐煉宦燞ackathon, and 馃鈥嶐煆燚emo Day!

  • All things agents!
  • LangChain vs. LlamaIndex
  • LangSmith and the evolving LLM Ops landscape
  • LLM Ops Hackathon!
  • Demo Day!
  • Graduation!



For all of the details on topics and tools covered each week, check out the detailed schedule below馃憞!

Free resource

馃搮 Detailed Schedule!

Want to know exactly what the assignments will be, when, and what tools they will use?

Yup send me the deets 鉁岋笍

10.0

(6 ratings)

What people are saying

聽聽聽聽聽聽聽聽Dedicated to the craft. What a team of instructors! What a community that is being built from the ground, on the cutting-edge, with enthusiasm. They have attracted a special group of practitioners and are selective in the process. At the intersection of data science, machine learning engineering, and MLOps comes the current future of LLMOps.
Todd Deshane

Todd Deshane

Chief Automation and Proof of Concept Specialist at the Intersection of Possible and Useful
聽聽聽聽聽聽聽聽Cannot recommend Ali, Chris & Greg ENOUGH when it comes to building/shipping/sharing LLM applications. They inspire a hands-on mentality and are exceptionally thoughtful and responsive to feedback and requests. They deliver bleeding-edge AI app walkthroughs and are amazing people to have in your community. Ali, Chris, and Greg - stay awesome!
Pano Evangeliou

Pano Evangeliou

Software Development Engineer
聽聽聽聽聽聽聽聽Ali, my technical mentor, demonstrated extraordinary dedication to teaching, always ready to offer support and assistance. Chris is an expert resource on LLMs with a supportive and approachable demeanor. Greg played a pivotal role in helping us accomplish what seemed impossible, encouraging us to think of ML from a product perspective.
Martin Rodrigo Moreno Otalvaro

Martin Rodrigo Moreno Otalvaro

Senior Data Scientist
聽聽聽聽聽聽聽聽Greg, Ali, and Chris deliver courses that stand out for their engaging group discussions, stimulating AMA sessions with professionals, and supportive network. They masterfully navigate key LLM concepts, introducing practical tools while fostering a product-focused mindset. An exceptional learning experience for those who love to build!
Rafael Arias Calles

Rafael Arias Calles

Machine Learning Engineer

Meet your instructional staff!

Dr. Greg Loughnane

Dr. Greg Loughnane

Founder & CEO @ AI Makerspace

I've worked as an AI product manager, university professor, data science consultant, AI startup advisor, and ML researcher; TEDx & keynote speaker, lecturing since 2013.


From 2021-2023 I worked at FourthBrain (Backed by Andrew Ng's AI Fund) to build industry-leading online bootcamps in ML Engineering and ML Operations (MLOps):


馃敆 Resources links: Deeplearning.ai demos, AI Makerspace demos, LinkedIn, Twitter, YouTube, Blog.

Chris "The LLM Wizard 馃獎" Alexiuk

Chris "The LLM Wizard 馃獎" Alexiuk

Head of LLMs @ AI Makerspace

I'm currently working as the Founding Machine Learning Engineer at Ox - but in my off time you can find me creating content for Machine Learning: either for the AI Makerspace, FourthBrain, or my YouTube Channel!


My motto is "Build, build, build!", and I'm excited to get building with all of you!


馃敆 Resources links: YouTube, LinkedIn, Twitter

Ali Kadhim

Ali Kadhim

LLM Consultant

I work with startup entrepreneurs to ideate, build, and deploy generative AI applications. Previously, I served as a product owner, machine learning lead, and MLOps instructor.


You can catch me in my off time building computers, woodworking projects, or building electronics.


馃敆 Resources links:聽LinkedIn

A pattern of wavy dots
Join an upcoming cohort

LLM Ops - Large Language Models in Production

LLMO3

$1,250 USD

Dates

Nov 29鈥擠ec 23, 2023

Application Deadline

Nov 29, 2023

|

Bulk purchases

Course schedule

10+ hrs
  • Class!

    Tuesdays & Thursdays, 4:00-6:00pm PT

    • Nov 28th, 30th
    • Dec 5th, Dec 7th
    • Dec 12th, Dec 14th
    • Dec 19th, Dec 21st


    * All sessions will be recorded for your viewing pleasure!

  • Community Sessions

    Mondays and Wednesdays

    • Building Your Personal Generative AI Brand: Mondays @ 4:30 PM PT
    • Community Build Sessions: Wednesdays @ Timing varies!
  • Office Hours

    Mondays, Thursdays, and Fridays

    • Greg Loughnane: Tuesdays @ 8 AM PT
    • Ali Kadhim: Tuesdays @ 10 AM PT
    • Chris Alexiuk: Fridays @ 3 PM PT
  • Programming Assignments

    Each class period, we will get hands-on with Python coding homework, due each Monday.

  • LLM Ops Hackathon

    Wednesday, Dec 20th from 11 AM - 5 PM PT

    • 11-2 PT: Team formation, project ideation, storytelling workshop, system diagram presentation
    • 2-5 PT: Build 馃彈锔, ship 馃殺, and share 馃殌 a RAG system with at least the following components: caching, evaluation, visibility聽
  • LLM Ops Demo Day

    December 21 at 4:00 PM PT

    • Open to the pubic - Friends, family, coworkers and bosses welcome!

Getting after it is better with like-minded builders

Getting after it is better with like-minded builders

Hands-on coding, every class

We're here to teach concepts AND code. Never one or the other.

Next-Level Breakout Rooms

Grow your network. Build together. Feel the difference that expert facilitation makes.

Meet Your Accountabilibuddies

Join a community of doers, aimed in the same career direction as you; that is, towards LLM Ops.

Frequently Asked Questions

What happens if I can鈥檛 make a live session?
I work full-time, what is the expected time commitment?
What鈥檚 the refund policy?
What if I don't know Git and how to use GitHub?
What if I'm not yet proficient in Python and the foundations of Machine Learning?

Stay in the loop

Sign up to be the first to know about course updates.

A pattern of wavy dots
Join an upcoming cohort

LLM Ops - Large Language Models in Production

LLMO3

$1,250 USD

Dates

Nov 29鈥擠ec 23, 2023

Application Deadline

Nov 29, 2023

|

Bulk purchases

$1,250 USD

10.0

(6)

4 Weeks