AI Evals in the Real World for Founders and PMs

Free Lesson

AI Evals in the Real World for Founders and PMs

Part of The AI-Powered Professional

•

Hosted by Rachel Dowling and Dasha Herrmannova

223 students

In this video

What you'll learn

Understand What AI Evals Are and Where They are Useful

We'll talk about what evals actually are and look at real examples to demystify where and how to use them

How to Start with AI Evals, and Go Beyond Vibes

A practical, no-nonsense path from ad-hoc testing to a repeatable system you can run on every change

How to Build an Eval Practice That Grows With Your Product

Your first eval is just the beginning – how to build on it incrementally so your testing grows alongside your product

Why this topic matters

You shipped the AI feature. Then a customer finds a prompt that breaks it. Most PMs respond with more manual testing and longer QA cycles. AI leaders build evals before shipping, so failures surface before going to prod. In 60 minutes, learn how to define what "good" means, how to catch edge cases early, and ship AI features with confidence, whether you are a founder or a PM.

You'll learn from

Rachel Dowling

CEO of Equal Time, ex-VP of Product @ TrustYou

Former VP of Product at TrustYou, an AI B2B SaaS company, and current CEO of Equal Time (venture backed AI startup).

I coach women in the Senior PM to Director: A Mentorship for Women in Product to achieve more than they thought possible and find their next aligned role at the Group PM, Director of Product and VP of Product level.

Dasha Herrmannova

AI Eval Data Scientist, Thomson Reuters

Dasha is a Lead Applied Scientist building and deploying AI evals for legal products. She previously worked on healthcare AI products, and brings over 10 years of experience in NLP and generative AI across academia, industry, and a government research lab.

Previously at