Cohort-based courses
Guided programs to get real results.
AI Evals For Engineers & PMs
4.7
·4 weeks·Sep 5 – Oct 3
Hamel Husain ML Engineer with 25 years of experience
Shreya Shankar ML Systems & Applied AI Evals Researcher
Build a Software Factory: Hands-off agentic coding for experienced engineers
4 weeks·Jul 21 – Aug 14
Matt Wynne Cucumber co-founder, BDD pioneer
+ Aldric Giacomoni, Jeremy Lightsmith, and Zach Marcin
Hardcore Agentic Engineering for builders who ship
NEW·3 weeks·Aug 3 – Aug 21
Greg Ceccarelli Founder, SpecStory • Ex-CPO, Pluralsight
+ Sean Johnson and Jake Levirne
AI Evals and Analytics Playbook
5.0
·3 weeks·Jun 29 – Jul 20
Stella Liu Head of AI Applied Science
Amy Chen Cofounder, AI Evals & Analytics
Beyond Evals: Designing Improvement Flywheels for AI Products
4.7
·3 weeks·Sep 19 – Oct 10.png&w=256&q=75)
Aishwarya Naresh Reganti AI Founder & Advisor to F500s | Ex-AWS
Kiriti Badam Applied AI @ OpenAI Codex | Ex-Google
Production-Ready Systems with LLMs and Agents: An Intensive for Engineers
NEW·6 weeks·Jul 13 – Aug 23
Ehsan GazarPrincipal Engineer | AI & System Design
Practitioner in AI risk and cost management
NEW·2 weeks·Jul 24 – Aug 7
Ian JohnsFormer Chief Architect at KCL
Build AI Agents for Enterprises
NEW·4 weeks·Jul 20 – Aug 16
Skanda VivekHow to build reliable agents
1-day workshops
Short, focused sessions to build specific skills.
Free Lightning Lessons
Interactive sessions to explore new topics.
How to Setup Evals For Agents
·30 minutes2,041 StudentsWatch
Harrison Chase, Hamel Husain, andAI Evals for Building Reliable and Consistent Products
·Jul 21·60 minutes192 StudentsLive
Anshumani RuddraExperimentation in the AI Era: Lessons from the Trenches
·60 minutes127 StudentsWatch
Mirza Rahim Baig and Vishnukant PeddawadRaise Your Technical Bar as an AI-Native PM
·30 minutes15,951 StudentsWatch
Jason P. Yoong and Gayathri Keerthana (GK)Evaluate Your RAG: Is It Actually Right?
·30 minutes17 StudentsWatch
Aki Wijesundara and Manu JayawardanaMastering Agentic RAG & AI Evals
·60 minutes1,304 StudentsWatch.png&w=1536&q=75)
Dr. Ryan Ahmed, Ph.D., MBA and Kukesh KodessLLM-as-Judge: Grade Your AI Feature's Quality
·30 minutes21 StudentsWatchAki Wijesundara and Manu JayawardanaPressure-test any AI analysis
·60 minutes837 StudentsWatch
Shane Butler, Sravya Madipalli, and Hai GuanThe New Frontier of AI Search
·75 minutes113 StudentsWatch
Trey Grainger and Doug TurnbullWhat Makes a Good Search Agent?
·Jul 13·60 minutes77 StudentsLive
Nandan Thakur and Hamel HusainFrom trading idea to validated strategy
·30 minutes101 StudentsWatch
Stefan JansenTurn Eval Results Into a Better Model
·Jul 31·45 minutes31 StudentsLive
Will Brown, Florian Brand, and Hamel HusainLLM-as-Judge: Score Your AI Automatically
·Jul 22·30 minutes19 StudentsLiveAki Wijesundara and Manu JayawardanaAI Evals for Product Managers
·60 minutes2,049 StudentsWatchAnshumani RuddraBuild Multi-Agent Systems You Can Audit
·30 minutes114 StudentsWatchStefan JansenBuild Your Own Eval Tools With Notebooks!
·45 minutes619 StudentsWatch
Vincent D. Warmerdam, Hamel Husain, and Shreya ShankarDebug the weird stuff your AI does (in less than 1 hour)
·45 minutes5,179 StudentsWatch.webp&w=1536&q=75)
Marily Nika and Hamel HusainEvaluating Agentic AI Applications Beyond Vibe Checks
·45 minutes1,257 StudentsWatch
Aishwarya Naresh Reganti, Kiriti Badam, and Claire LongoBuild Your AI Evals & Analytics Playbook
·30 minutes545 StudentsWatch
Stella Liu and Amy ChenProduction Grade AI Evals by Braintrust.dev
·30 minutes514 StudentsWatch
Mengying LiScale Evals Without the Chaos
·45 minutes258 StudentsWatch
Aishwarya Naresh RegantiMastering LLM Application Testing
·30 minutes242 StudentsWatch
Hugo Bowne-Anderson and Stefan KrawczykSynthetic RAG evaluation
·60 minutes217 StudentsWatch
Alexey Grigorev and Doug TurnbullStop RAG Hallucinations With Citations
·30 minutes9 StudentsWatchAki Wijesundara and Manu JayawardanaModern Information Retrieval Evaluation In The RAG Era
·45 minutes5,388 StudentsWatch
Nandan Thakur, Hamel Husain, and Shreya ShankarError Analysis: The AI Engineer’s Best ROI
·60 minutes1,522 StudentsWatch
Hamel Husain and Shreya ShankarEvaluating AI Agents
·45 minutes1,438 StudentsWatch
Amir Feizpour and Samuel Dion-GirardeauSetting Eval for AI Agents & Scaling with Auto-Evaluation
·30 minutes867 StudentsWatch
Mahesh YadavOptimize Structured Data Retrieval With Evals
·45 minutes846 StudentsWatch
Daniel Svonava and Hamel HusainOnline Evals and Production Monitoring
·60 minutes832 StudentsWatch
Jason Liu, Ben Hylak, and Sidhant BendreEvaluate AI agents with Confidence
·45 minutes804 StudentsWatch
Mahesh YadavDesign Evals Users Will Trust
·45 minutes784 StudentsWatch
Aishwarya Naresh RegantiPractical Evaluation Strategies for AI Agents
·45 minutes477 StudentsWatch
Hamza Farooq and Gabriela de QueirozHow to Drive AI Evals Adoption
·30 minutes335 StudentsWatch
Dr Sebastian FoxCreate MCP Tool Evals Before You Ship
·45 minutes286 StudentsWatch
Emmanuel ParaskakisEvals for Voice AI: Learnings from Google Evals Team
·30 minutes254 StudentsWatch
Ravin KumarShip a Production Cursor Agent System in 30 Minutes
·30 minutes220 StudentsWatch
Carmelo IariaEvals in Action With Arize
·45 minutes214 StudentsWatch
Laurie VossCalibrate LLM-as-a-judge for Real-world Impact
·45 minutes210 StudentsWatch
Eddie LandesbergHow to test and improve your AI agents
·45 minutes168 StudentsWatch
Jacob BankPart 3: Building Robust Evaluations for AI Agents
·60 minutes146 StudentsWatch
Hamza Farooq and Gabriela de QueirozRun Eval Loops and Guardrails for Cursor Agents
·30 minutes92 StudentsWatchCarmelo IariaEvaluating AI Agents before Users Break Them
·60 minutes91 StudentsWatch
Aki Wijesundara, PhD, Marc Klingen, and Lotte VerheydenGo Beyond AI Evals: Diagnose and Decide
·45 minutes58 StudentsWatch
Rajiv ShahDebug Cursor Agent Failures Before Production
·30 minutes47 StudentsWatchCarmelo IariaStop Paying Full Price for LLM Classification
·Jul 30·45 minutes14 StudentsLive
Shreya Shankar and Hamel HusainAutomating Evals With Claude Code + Phoenix
·60 minutes2,367 StudentsWatch
Mikyo King and Hamel HusainEvals for Everyone
·3 lessons2,203 StudentsWatch
Aishwarya & KiritiFrom Automation to Multi-Agent Architectures
·3 lessons1,365 StudentsWatch
Hamza FarooqUnderstanding Embedding Performance through Generative Evals
·60 minutes1,181 StudentsWatch
Jason Liu and Kelly HongHow OpenAI Customers Use Evals To Build Better AI Products
·30 minutes1,084 StudentsWatch
Jim Blomo and Hamel HusainHow Evals Made GitHub Copilot Happen
·30 minutes894 StudentsWatch
John Berryman, Shawn Simister, and Hamel HusainLearn Agentic AI: Setting agents metrics and evaluations
·45 minutes864 StudentsWatch
Mahesh YadavAI Systems Under Pressure: Red-Team Before You Ship
·60 minutes804 StudentsWatch
Krystal JacksonImprove reliability of your AI applications
·30 minutes747 StudentsWatch
Shreya RajpalOptimize Your Dev Setup For Evals w/ Cursor Rules & MCP
·30 minutes691 StudentsWatch
Isaac Flath, Hamel Husain, and Shreya ShankarEvaluation Driven Development for Agentic AI Systems
·45 minutes592 StudentsWatch.jpg&w=1536&q=75)
Aurimas GriciūnasHow You Catch Production Hallucinations in Real Time
·60 minutes505 StudentsWatch
Jason Liu and Julia NeaguScaling Judge-Time Compute for Robust Auto LLM Evaluation
·60 minutes489 StudentsWatch
Jason Liu and Leonard TangStrategies for building self-improving document processing
·60 minutes431 StudentsWatch
Jason Liu and Eli BadgioMaster Evaluation Techniques for LLM Apps
·30 minutes413 StudentsWatch
Haroon ChouderyUnderstand SHAP (SHapley Additive exPlanations)
·30 minutes311 StudentsWatch
Patrick HallReliable RAG Agents: Intent-Driven Failure Detection
·60 minutes299 StudentsWatch
.png&w=1536&q=75)
Jason Liu and Ben HylakDon't Tweak Prompts. Engineer Agents.
·30 minutes274 StudentsWatch
Hugo Bowne-Anderson and Skylar Payne🛠 Synthetic Data Flywheels: Build Reliable LLM Apps Faster
·30 minutes189 StudentsWatch
Hugo Bowne-Anderson and Stefan KrawczykThe Hidden Signal in Production AI Logs
·60 minutes174 StudentsWatch
Jason Liu and Scott ClarkDe-Risking LLM Model Switches w Evals & Prompt Optimization
·45 minutes146 StudentsWatch
Amir Feizpour and Hugo MailhotCollaborative AI Evals with Human Feedback
·30 minutes121 StudentsWatch
Rogério ChavesStay Ahead in AI: Evaluate Any New LLM in 15 Minutes
·30 minutes95 StudentsWatch
Sherveen MashayekhiSetting up your first AI eval with a LLM-as-judge
·45 minutes69 StudentsWatch
Madalina Turlea and Catalina TurleaHow to test AI when you don't have any data yet
·45 minutes27 StudentsWatchMadalina Turlea and Catalina TurleaLangfuse 101: See Inside Your AI App
·Jul 21·30 minutes10 StudentsLiveAki Wijesundara and Manu Jayawardana