5.0
(5 ratings)
4 Weeks
Β·Cohort-based Course
Master Large Language Model architecture, pretraining, prompt engineering, fine-tuning, and alignment. From the Transformer to RLAIF.
5.0
(5 ratings)
4 Weeks
Β·Cohort-based Course
Master Large Language Model architecture, pretraining, prompt engineering, fine-tuning, and alignment. From the Transformer to RLAIF.
Course overview
Data science and engineering teams around the world are being asked to rapidly build LLM applications through prompt engineering and supervised fine-tuning. Some companies are even working to train their own proprietary domain-specific LLMs from scratch!
In order to build a "ChatGPT" for your customers or internal stakeholders, using your own proprietary data, you'll want to understand how GPT-style models are actually built, step-by-step.
From closed-source models like OpenAI's GPT-series, Google's PaLM models, Anthropic's Claude, others, to open-source models like LLaMA 2-70B, Mistral-7B, 01.AI's Yi-34B, Mosaic's MPT-30B, or Falcon-180B, these decoder-only architectures are at the core, made in the same way.
This course will provide you with the foundational concepts and code you need to demystify how these models are created, from soup to nuts and to actually get started training, fine-tuning, and aligning your own LLMs.
From there, it's up to you to make the business case, organize the data, and secure the compute to give your company and your career a competitive LLM advantage.
01
Aspiring AI Engineers looking to explore new career opportunities in Generative AI
02
Data scientists and Machine Learning Engineers who want to train their own LLMs
03
Stakeholders interested in training and deploying proprietary LLMs and applications
LLM Engineering - The Foundations
Week 1
Week 1
Jan 10βJan 14
Modules
Week 2
Week 2
Jan 15βJan 21
Modules
Week 3
Week 3
Jan 22βJan 28
Modules
Week 4
Week 4
Jan 29βFeb 2
Modules
Post-Course
Post-Course
Modules
5.0
(5 ratings)
Understanding supervised learning, unsupervised learning, and neural network architectures are required. Introductory NLP and CV knowledge is encouraged.
Understand basic Python syntax and constructs. You should be comfortable training and evaluating simple ML & DL models using test, train, and dev sets.
Understand how everything comes together in the course to provide a holistic overview of foundational LLM Engineering.
Get all the details about the assignments, and also get links to the papers that we'll be discussing!
Harpreet Sahota
Juan Olano
Founder & CEO @ AI Makerspace
I've worked as an AI product manager, university professor, data science consultant, AI startup advisor, and ML researcher; TEDx & keynote speaker, lecturing since 2013.
From 2021-2023 I worked at FourthBrain (Backed by Andrew Ng's AI Fund) to build industry-leading online bootcamps in ML Engineering and ML Operations (MLOps):
π Resources links:Β Deeplearning.ai demos,Β AI Makerspace demos,Β LinkedIn,Β Twitter,Β YouTube,Β Blog.
Co-Founder & CTO @ AI Makerspace
I'm currently working as the Founding Machine Learning Engineer at Ox - but in my off time you can find me creating content for Machine Learning: either for the AI Makerspace, FourthBrain, or my YouTube Channel!
My motto is "Build, build, build!", and I'm excited to get building with all of you!
Cohort 2
$1,250 USD
Dates
Jan 10βFeb 2, 2024
Application Deadline
Jan 10, 2024
Cohort 3
$1,250 USD
Dates
Mar 19βApr 12, 2024
Application Deadline
Mar 19, 2024
Tuesdays & Thursdays, 4:00-6:00pm PT
2-4 hours per week
Each class period, we will get hands-on with Python coding homework!
Tuesdays and Fridays
Get hands-on with code, every class
We're here to teach concepts plus code. Never one or the other.
Pair programming made fun and easy
Grow your network. Build together. Feel the difference that expert facilitation makes.
Meet your accountability buddies
Join a community of doers, aimed in the same career direction as you are.
Cohort 2
$1,250 USD
Dates
Jan 10βFeb 2, 2024
Application Deadline
Jan 10, 2024
Cohort 3
$1,250 USD
Dates
Mar 19βApr 12, 2024
Application Deadline
Mar 19, 2024
$1,250 USD
5.0
(5)
4 Weeks