AI Evals Certification: Master Building Reliable AI
Stella Liu
Head of AI Applied Science
Amy Chen
Cofounder, AI Evals & Analytics
Follow a structured learning program, build reliable AI and earn a certification
🔹 “I can immediately apply what I have learned in the course to my everyday work.”
— AI PM, education industry
🔹 “In a short time, it gave me a clear and practical framework for thinking about how to measure the success of AI products.”
— Sr Data Scientist, medical industry
🔹 "I am already using things I learned in my work and seeing valuable results."
— Sr ML Engr, cybersecurity startup
◽️◽️◽️
📚 30 core lectures, 3 hands-on workshops, 7 bonus expert lectures, 1:1 consulting sessionsBuild stakeholder buy-in and evals team
Human vs. automated evals
Qualitative & Quantitative evals
Test set generation
Production analytics and monitoring
How to measure business impact
Bonus topics (multimodal evals, AI governance, vendor tools and more)
🚀 We've partnered with Moonshot AI. All students will get free credits and special discounts for Kimi API.
◽️◽️◽️
💡Want to preview the course?
💰 Purchasing-power-parity pricing adjustments available
✉️ Email us at StellaxAmy@gmail.com
What you’ll learn
Learn how to evaluate, ship, and monitor GenAI products that perform reliably in production.
Design qualitative evaluation workflows for AI systems
Implement automated quantitative evaluations at scale
Use online evals and analytics to inform iteration, rollback, and roadmap decisions
Diagnose how GenAI systems fail and where risks emerge
Design guardrails and evaluation strategies before release
Monitor AI behavior in production to detect and manage risks
Gain hands-on experience running an AI evals project
Learn how to design AI evals metrics that drive decisions
Apply Evaluation-Driven Development (EDD) to guide product iteration during development
Learn directly from Stella & Amy
See all products from AI Evals and Analytics
Who this course is for
Product Leaders
Building GenAI products and need a clear playbook for evaluation frameworks, success metrics, and shipping with confidence.
Data Scientists
Leveling up with AI product skills: learn AI evals, LLM-as-a-judge, and design metrics for GenAI systems.
QA and Test Engineer
Adapting traditional testing practices to GenAI systems.
What's included
Live sessions
Learn directly from Stella Liu & Amy Chen in a real-time, interactive format.
Your First AI Evals and Analytics Playbook
Create your first AI Evals playbook and apply it on your current projects.
Glossary Sheet
Master the terminology with clear definitions and practical examples for every key concept in AI Evals.
Lifetime access
Go back to course content and recordings whenever you need to.
Community of peers
Stay accountable and share insights with like-minded professionals.
Certificate of completion
Share your new skills with your employer or on LinkedIn.
Maven Guarantee
Your purchase is backed by the Maven Guarantee.
Course syllabus
Week 1
Module 0: What Is AI Evals?
Module 1: Getting Buy-in
💡 Topic: AI Evals Vendor Tools
Module 2: Framework Overview + AI Evals Scope & Roles
Module 3: Evaluation Methodologies
Module 4: Qualitative Evaluations
Saturday 1:1 Office Hours
Free resources
Schedule
Live sessions
4 hrs / week
Sat, Sep 19
9:00 PM—9:30 PM (UTC)
Projects
1 hr / week
Async content
1 hr / week
Frequently asked questions
Maven for Teams
Reimbursement
Get your company to pay
Everything L&D needs: email template, receipts, and certificate of completion.
Get reimbursedPrivate cohort
Run a cohort for your org
A dedicated cohort with a custom schedule and curriculum, tailored to your team.
Book a private cohort