Madalina Turlea
Catalina Turlea
Free Lesson

AI Evals and Experimentation as Product Discovery

30 min
Dec 8, 2026 11:00 AM

By continuing, you agree to Maven's Terms and Privacy Policy.

What you'll learn

See where different models actually disagree

Run one instruction through several models blind, so the full range of failures shows up instead of one model's habits.

Annotate like a researcher, not a tester.

Read real outputs closely and write down what is wrong and why. This is where the requirements come from.

Turn error analysis into rubric criteria.

Cluster the failure notes and convert them into checks that run automatically. Then keep running them.

Why this topic matters

For deterministic software, acceptance criteria describe what “working” means before you build. For a probabilistic product, nobody can write that list upfront, because nobody knows yet where the model will go wrong. You discover the definition of good by looking at real outputs, and the eval is where that definition gets written down. That makes evals a discovery method, not a testing step.

You'll learn from

Madalina Turlea

Madalina Turlea

Co-founder & CPO @Lovelaice, 10+ years in Product in FinTech

Finastra
Printify
Catalina Turlea

Catalina Turlea

Founder & CEO @Lovelaice | Co-founder & CTO @nilo | 14 years in tech

Nilo
Freeletics
Teleclinic
SIXT Group
1&1
See all products from Madalina
Get free access