Evaluation-Driven Development for AI PMs

Hosted by Roger Jin

Wed, Aug 27, 2025

4:00 PM UTC (30 minutes)

Virtual (Zoom)

Free to join

58 students

Invite your network

What you'll learn

The Mindset Shift Needed to Build AI-Native Products

Why the probabilistic nature of AI breaks the traditional PRD and requires a new mindset focused on quality and trust

The New OS for AI Product Management

How Eval-Driven Development (EDD) is replacing Feature-Driven Development (FDD) as the new standard for AI products.

The 5-Step Eval-Driven Development Playbook

A step-by-step guide to implementing EDD, from defining objective, building a "golden set" to creating an eval scorecard

The Product Leader's Evolved Role

How your role as a product leader transforms from a feature specifier to the architect of the evaluation framework.

Why this topic matters

Over 80% of AI projects fail – not due to tech issues, but because teams are applying an outdated playbook to a new, non-deterministic game. Eval-Driven Development has evolved as the new OS for AI product management as seen in many successful AI product teams, large and small. In addition to PRDs, you’ll focus on creating dynamic evaluation frameworks that define success in measurable terms.

You'll learn from

Roger Jin

ex-Product Lead for Gemini@Google DeepMind, 2x Founder, AI Strategy Coach

I'm an ICF-certified coach and a seasoned product leader who has operated at the frontier of AI development and in the trenches of building venture-backed companies. 

As Head of Product at Google DeepMind, I was a founding member of the product team that launched Gemini, Google's flagship generative AI product. Before that, I led product teams at Amazon Alexa, pushing the boundaries of customer experience for millions of users. 

I’ve also co-founded two AI startups, raising over $20M in venture capital and scaling them to a combined $80M+ in annual revenue. 

I built this lesson because I've seen firsthand that the teams who win in AI aren't just the ones with the best models—they're the ones with the best development OS. I'm here to share that playbook with you.


Follow me on LinkedIn.

Previously at Google DeepMind & Amazon

Google
Amazon

Sign up to join this lesson

By continuing, you agree to Maven's Terms and Privacy Policy.

© 2025 Maven Learning, Inc.