I started my career working on ML using the fastai framework, before spending 4 years at Hugging Face leading the Accelerate framework and working on Transformers. Today, I lead developer relations at Lambda teaching others how to handle the large-scale distributed workloads modern day models require
Head of Developer Relations at Lambda


Courses
Multi-day, guided programs to get real results
Lightning Lessons
Free, interactive sessions to explore new topics
Lightning Lesson1 hour

How to train your tiny MoE: Going from 60+ hours to 13
WATCH
Watch now Lightning Lesson30 minutes

How to Make High-Level Frameworks Work For You (Part 3)
WATCH
Watch now Lightning Lesson30 minutes

Why Low-Level Training Frameworks Save Us (Part 2)
WATCH
Watch now Lightning Lesson30 minutes

Why High-Level Training Frameworks are a Crutch (Part 1)
WATCH
Watch now Lightning Lesson45 minutes

The Distributed Training Taxonomy: DP, PP, and more
WATCH
Watch now Lightning Lesson45 minutes

How to Utilize a Cluster: All About SLURM
WATCH
Watch now Resources
Alumni reviews
Harshit
Live cohort
Lead Software Engineer II · CONFIDENTIAL
Scratch to Scale: Real-World HPC Training
This the gold mine i was searching for more then a year.
Lalith
Live cohort
Senior System Software Designer · AMD
Scratch to Scale: Real-World HPC Training
Loved every bit! Thanks for the generous credits
Amardeep
Live cohort
Founder · AIEdx
Scratch to Scale: Real-World HPC Training
Best Course on distributed training
Nikhil
Live cohort
Sr deep learning engineer · Amazon
Scratch to Scale: Real-World HPC Training
It was very informative and helped me transition from model inference to model training
Muhammad
Live cohort
PhD Student · Tennessee Tech University
Scratch to Scale: Real-World HPC Training
Zach is an awesome teacher. Want to implement these techniques in my projects.

