How to train your tiny MoE: Going from 60+ hours to 13
Hosted by Zach Mueller
Fri, Oct 17, 2025
5:00 PM UTC (1 hour)
Virtual (Zoom)
Free to join
Go deeper with a course
Fri, Oct 17, 2025
5:00 PM UTC (1 hour)
Virtual (Zoom)
Free to join
105 students
Go deeper with a course
What you'll learn
How to find the easy wins during model training
How to tell *what* is causing slowdowns
What to do when you've optimized the training loop
Why this topic matters
You'll learn from
Zach Mueller
Technical Lead, Hugging Face
I've been in the field for almost a decade now. I first started in the fast.ai community, quickly learning how modern-day training pipelines are built and operated. Then I moved to Hugging Face, where I'm the Technical Lead on the accelerate project and manage the transformers Trainer.
By continuing, you agree to Maven's Terms and Privacy Policy.