Lightning Lessons

Build Your AI Evals & Analytics Playbook

Hosted by Stella Liu and Amy Chen

Tue, Oct 14, 2025

4:00 PM UTC (30 minutes)

Virtual (Zoom)

Free to join

108 students

Invite your network

Go deeper with a course

AI Evals and Analytics Playbook
Stella Liu and Amy Chen
View syllabus

What you'll learn

Understand What Is AI Evals and Why It Matters Now

It's part of your PRD. AI Evals helps you ship products confidently and safely.

Learn Core AI Evals Framework

Learn how to define metrics, test model quality, and align stakeholders from Legal to Trust & Safety.

Get Started with Your Evals Playbook

Understand how to start your first evals plan and start building with best Evals practice

Why this topic matters

With OpenAI expanding Evals in the latest AgentKit release and Lenny Rachitsky calling it the “era of evals,” mastering AI Evals and Analytics is crucial for advancing AI products responsibly. This lesson gives product leaders, builders, data scientists, and AI engineers an in-depth view of AI evals and practical frameworks.

You'll learn from

Stella Liu

Head of AI Evals at ASU

Stella Liu is co-founder of AI Evals & Analytics and an AI Evaluation scientist and researcher, specializing in frameworks for large language models and AI-powered products.


Since 2023, she has led real-world AI evaluation projects in EdTech, where she established the first AI product evaluation framework for Higher Education and continues to advance research on the safe and responsible use of AI. Her work combines academic rigor with hands-on product experience, bringing proven evaluation methods into both enterprise and educational contexts.


Earlier in her career, Stella worked at Shopify and Carvana, where she built large-scale data-driven automation systems that powered product innovation and operational efficiency at scale.


She is Top 1% Mentor in Data Science on ADPList.


Follow Stella on LinkedIn

Amy Chen

Co-Founder at AI Evals & Analytics

Amy Chen is co-founder of AI Evals & Analytics and an AI partner helping companies with AI engineering, product development, and go-to-market strategy. With over 10 years of experience spanning data science, product management, ML engineering, and GTM, she brings versatile expertise to startups at every stage.


She is Top 1% Mentor in AI/ML Engineering and mentored over 300 data scientists and analysts on ADPList. She posts regularly about AI and data science on LinkedIn and has over 9.5k followers.


Follow Amy on LinkedIn

Previously at

Shopify.com
Carvana
Harvard University
University of Washington
UCLA

Sign up to join this lesson

By continuing, you agree to Maven's Terms and Privacy Policy.