Free Lesson

AI Evals in the Real World for Founders and PMs

Hosted by Rachel Dowling and Dasha Herrmannova

Thu, Jul 9, 2026

6:00 PM UTC (45 minutes)

Virtual (Zoom)

Free to join

Invite your network

Go deeper with a course

Senior PM to Director: A Mentorship for Women in Product
Rachel Dowling
View syllabus

What you'll learn

Learn What AI Evals Are, and How to Use Them Concretely

Turn fuzzy AI quality goals into a concrete eval set. We'll build one live for a real product use case.

Catch Edge Cases Your Manual Testing Did Not Surface

Use rule-based, LLM-judge, and human evals to spot the failures your customers will find before they find them.

Run a Roadmap Decision Off Real Eval Results

Read regressions, defend trade-offs between models, and turn a results table into a clear call on what to ship next

Why this topic matters

You shipped the AI feature. Then a customer finds a prompt that breaks it. Most PMs respond with more manual testing and longer QA cycles. AI leaders build evals before shipping, so failures surface before going to prod. In 30 minutes, learn how to define what "good" means, how to catch edge cases early, and ship AI features with confidence, whether you are a founder or a PM.

You'll learn from

Rachel Dowling

CEO of Equal Time, ex-VP of Product @ TrustYou

Former VP of Product at TrustYou, an AI B2B SaaS company (leading $100M ARR and 10 product teams), and current CEO of Equal Time (venture backed AI startup).

I coach women in the Career Transition Accelerator for Women in Product to achieve more than they thought possible and find their next aligned product role at the Principal, Group PM, Director of Product and VP of Product level.

Dasha Herrmannova

AI Eval Data Scientist, Thomson Reuters

Dasha is a highly skilled data scientist with over six years of experience from academia, industry, and a government research lab. Passionate about leveraging AI to enable intelligent access to the content of scientific, biomedical, and other expert literature. I am an experienced technical lead capable of driving AL evals deployed in real-world settings for founders and enterprise PMs.

Previously at

Stanford University
University of Oxford
TrustYou
Equal Time
Thomson Reuters
See all products from Women's Product Leadership

Sign up to join this lesson

By continuing, you agree to Maven's Terms and Privacy Policy.