Free Lesson

How Production AI Teams Actually Grade Their Agents

Hosted by Mahesh Yadav

Fri, Aug 14, 2026

4:00 PM UTC (45 minutes)

Virtual (Zoom)

Free to join

Invite your network

Go deeper with a course

Agentic AI Product Management Certification using Claude Code
Mahesh Yadav
View syllabus

What you'll learn

See the eval stack production teams run

Not theory: the actual pipeline used to grade agents before they ship.

Build an LLM-as-judge that holds up

Learn exactly where automated grading breaks and how top teams catch it.

Grade agents on outcomes, not vibes

The real KPIs production teams track: completion, efficiency, satisfaction.

Catch failures before your users do

Map the blind spots most teams only discover after launch.

Why this topic matters

Every AI team claims their agent works. Almost none can show you how they know. This session pulls back the curtain on the eval stack production teams actually run: LLM-as-judge setups, real KPIs, and the checks that catch failures before launch. You'll leave with the same framework used to grade agents before they ship, not just the theory behind evals.

You'll learn from

Mahesh Yadav

Ex AI Product Lead -Google l Meta l Microsoft l AWS | 10k+ Alums l Founder - Agentic AI Institute

Mahesh Yadav brings 20+ years of experience building AI products at Google, Meta, AWS, Microsoft. He holds 12 patents in AI training, power management and computer vision. He has launched major agentic-AI initiatives (for example launching an agent for AWS Bedrock, featured in CEO keynote) and trained thousands of professionals to succeed in AI roles. With this programme you get rare access to CEO-level of mentorship.
Substack AI PM Newsletter l Linkedin Community of AI PMs l YouTube For Free Sessions Recordings
Currently, he is building back-office AI agents for the enterprise, starting with in-house legal teams through LegalGraph.AI. His work bridges education and real-world AI deployment, helping organizations adopt agentic systems that automate complex knowledge work.

Previously at

Google
Meta
Microsoft
Amazon Web Services
See all products from Mahesh

Sign up to join this lesson

By continuing, you agree to Maven's Terms and Privacy Policy.