Build an eval rubric for your AI Product from scratch

Hosted by Madalina Turlea and Catalina Turlea

Thu, Aug 27, 2026

12:00 PM UTC (30 minutes)

Virtual (Zoom)

Free to join

Invite your network

Go deeper with a course

AI Product Building Loop: From first prompt to evals, in multiple iterations
Madalina Turlea and Catalina Turlea
View syllabus

What you'll learn

See where different models actually disagree

Run one instruction through several models blind, so the full range of failures shows up instead of one model's habits.

Annotate outputs to find how the AI actually fails

Learn how to zoom into real AI answers and provide qualifiable feedback into an error analysis

Turn error analysis into rubric criteria

Cluster the failure notes and convert the persistent ones into checks you can score automatically

Why this topic matters

Eval rubrics usually get written upfront, before anyone has looked at a single LLM output. They end up measuring imagined problems in vague words: helpful, accurate, on-brand, scored 1 to 5. Read a few outputs and none of them fit. In 30 minutes we flip it: start from the outputs, annotate where they break, and grow an eval rubric that catches failures before your users do.

You'll learn from

Madalina Turlea

Co-founder @Lovelaice, 10+ years in Product

I'm co-founder of Lovelaice and a product leader with 10+ years building products across fintech, payments, and compliance. I hold a CFA charter and have led AI product development in highly regulated environments, where AI failures aren't just embarrassing, they're liabilities.

I've watched smart product teams make the same mistakes: choosing models based on benchmarks that don't reflect their use case, writing prompts that work in demos but fail in production, and leaving domain experts and PMs out of the AI iteration loop.

Through these failures (my own included), I developed a systematic approach to AI experimentation that puts product and domain expertise at the center. I teach what I've learned building Lovelaice: how to test, evaluate, and iterate on AI, before it reaches your users.

Catalina Turlea

Founder @Lovelaice

I bring over 14 years of software development expertise and a decade of startup experience to help teams build AI products that actually work. After founding my first company six years ago, I run a consultancy specializing in helping startups build MVPs, solve complex technical challenges, and integrate AI effectively.

I've seen firsthand how AI projects fail due to lack of systematic experimentation. Teams treat AI like traditional software and struggle with inconsistent results. That's why I co-created Lovelaice, a platform designed for non-technical professionals to experiment with AI agents systematically.

See all products from Madalina

Sign up to join this lesson

By continuing, you agree to Maven's Terms and Privacy Policy.