From Evals to Scaling AI Trust
Subha Shetty
Fractional Chief Product and AI Officer
From Experiments to Scale: How Leaders Build High-Performing, Trusted AI Systems
Evals are having a moment - and for good reason. As AI systems move from pilots to production, leaders are confronting a hard truth: performance without trust doesn’t scale and AI drift is real.
But evals alone are not the system.
This workshop reframes evals within a broader, executive lens: performance + governance = trust at scale. You’ll learn how leading organizations are moving beyond isolated testing toward building AI systems that are measurable, reliable, and continuously improving.
Grounded in insights from leading institutions and practitioners such as the WEF, McKinsey, Deloitte, Stanford HAI, and voices such as Dario Amodei, Andrew Ng and more - this session connects cutting-edge thinking to practical execution.
This is a highly interactive session. You will:
Work hands-on to design and build your own eval (for an AI or agent use case)
Explore how Guardian Agents, KYA (Know Your Agent), and feedback loops enable trust at scale
Why This Matters Now
The conversation is shifting from What can AI do? to
Can this system scale and be trusted?
Winning leaders will go beyond the best pilots - they will build high-performance governed AI systems that are continuously improving.
Workshop agenda
- 3:00PM EDT
What is Trust
Learn a framework to reuse for AI Trust
- 3:15PM EDT
Industry Context
Get the latest signals on what top research firms are saying and what companies are doing
- 3:30PM EDT
Design your eval
Design your first eval or improve an existing eval
- 4:15PM EDT
Design your governance policy
Design live your detailed AI governance policy for your team or your company
- 4:45PM EDT
Play a game
Bring all the learning together by playing a fun game that will help you decide and make the right choices for various AI trust issues
- 5:30PM EDT
Close and connect
Summarize, close and a way to connect with each other and continue the learning
What you’ll learn
You will walk away with your first (or improved) eval. A trust framework with evals, governance, HITL, Guardian Agents and more...
Learn directly from Subha
Subha Shetty
AI-first product leader, transformation coach, and advisor to F100 and start-ups
Who this workshop is for
Senior product, eng, data, design and business leaders responsible for:scaling AI beyond pilots and ensuring trust, safety, and governance.
What's included
Live sessions
Learn directly from Subha Shetty in a real-time, interactive format.
Lifetime access
Go back to course content and recordings whenever you need to.
Community of peers
Stay accountable and share insights with like-minded professionals.
Certificate of completion
Share your new skills with your employer or on LinkedIn.
Consulting grade frameworks
From my AI consulting work with multiple clients, I will bring you well researched consulting grade frameworks to reuse at 1/10th the price of what consulting companies offer.
Take home exercises
To stretch yourself, you will get challenge exercises tto continue your learning offline.
Maven Guarantee
Your purchase is backed by the Maven Guarantee.
Frequently asked questions
$495
USD