Free Lesson

Build an eval rubric for your AI Product from scratch

30 min
Aug 27, 2026 8:00 AM
Virtual (Zoom)

In this video

What you'll learn

See where different models actually disagree

Run one instruction through several models blind, so the full range of failures shows up instead of one model's habits.

Annotate outputs to find how the AI actually fails

Learn how to zoom into real AI answers and provide qualifiable feedback into an error analysis

Turn error analysis into rubric criteria

Cluster the failure notes and convert the persistent ones into checks you can score automatically

Why this topic matters

Eval rubrics usually get written upfront, before anyone has looked at a single LLM output. They end up measuring imagined problems in vague words: helpful, accurate, on-brand, scored 1 to 5. Read a few outputs and none of them fit. In 30 minutes we flip it: start from the outputs, annotate where they break, and grow an eval rubric that catches failures before your users do.

You'll learn from

Madalina Turlea

Madalina Turlea

Co-founder & CPO @Lovelaice, 10+ years in Product in FinTech

Finastra
Printify
Catalina Turlea

Catalina Turlea

Founder & CEO @Lovelaice | Co-founder & CTO @nilo | 14 years in tech

Nilo
Freeletics
Teleclinic
SIXT Group
1&1
See all products from Madalina