Workshop

AI Trust at Scale. From Evals to Governance

Subha Shetty

Fractional Chief Product and AI Officer

From Experiments to Scale: How Leaders Build High-Performing, Trusted AI Systems

Evals are having a moment - and for good reason. As AI systems move from pilots to production, leaders are confronting a hard truth: performance without trust doesn’t scale and AI drift is real.

But evals alone are not the system.

This workshop reframes evals within a broader, executive lens: performance + governance = trust at scale. You’ll learn how leading organizations are moving beyond isolated testing toward building AI systems that are measurable, reliable, and continuously improving.

Grounded in insights from leading institutions and practitioners such as the WEF, McKinsey, Deloitte, Stanford HAI, and voices such as Dario Amodei, Andrew Ng and more - this session connects cutting-edge thinking to practical execution.

This is a highly interactive session. You will:

  • ​Work hands-on to design and build your own eval (for an AI or agent use case)

  • ​Explore how Guardian Agents, KYA (Know Your Agent), and feedback loops enable trust at scale

    Why This Matters Now
    The conversation is shifting from What can AI do? to
    Can this system scale and be trusted?

    Winning leaders will go beyond the best pilots - they will build high-performance governed AI systems that are continuously improving.

What you’ll learn

You will walk away with your first (or improved) eval. A trust framework with evals, governance, HITL, Guardian Agents and more...

  • Know the 4 different dimensions of AI trust

  • Understand which dimension is the issue in the company and address it accordingly

  • If you haven't written an eval, you will build one. If youy have written one, lets improve it.

  • Did you know that aside from evals, there are ~20 techniques to improve Trust?

  • Know in detail about each technique and know which one solves which Trust problem

  • Based on Claude's Constitutional AI, write your own team's or company's AI Governance policy draft

Workshop agenda

  • What is Trust

    Learn a framework to reuse for AI Trust

  • Industry Context

    Get the latest signals on what top research firms are saying and what companies are doing

  • Design your eval

    Design your first eval or improve an existing eval

  • Design your governance policy

    Design live your detailed AI governance policy for your team or your company

  • Play a game

    Bring all the learning together by playing a fun game that will help you decide and make the right choices for various AI trust issues

  • Close and connect

    Summarize, close and a way to connect with each other and continue the learning

Learn directly from Subha

Subha Shetty

Subha Shetty

Contact

AI-first product leader, transformation coach, and advisor to F100 and start-ups

Fanatics
eBay Inc.
Walmart
Upwork
See all products from Subha

Who this workshop is for

  • For product/AI leaders scaling systems

    • You run evals but unsure they're measuring the right things

    • You need a system to catch AI drift early

  • For leaders dealing with org trust

    • Stakeholders are skeptical of AI and you can't articulate why

    • You're asked to "make AI more reliable"

  • For leaders moving from pilots to production

    • You're responsible for AI quality and inherited a system with fuzzy measurement infrastructure

What's included

Subha Shetty

Live sessions

Learn directly from Subha Shetty in a real-time, interactive format.

Lifetime access

Go back to course content and recordings whenever you need to.

Community of peers

Stay accountable and share insights with like-minded professionals.

Certificate of completion

Share your new skills with your employer or on LinkedIn.

Consulting grade frameworks

From my AI consulting work with multiple clients, I will bring you well researched consulting grade frameworks to reuse at 1/10th the price of what consulting companies offer.

Take home exercises

To stretch yourself, you will get challenge exercises tto continue your learning offline.

Maven Guarantee

Your purchase is backed by the Maven Guarantee.

Frequently asked questions

Maven for Teams

Reimbursement

Get your company to pay

Everything L&D needs: email template, receipts, and certificate of completion.

Get reimbursed

Team discount

Learn with your teammates

Save 20%+ when 2 or more teammates enroll in the same cohort.

Save 20%+ with a team

Private cohort

Run a cohort for your org

A dedicated cohort with a custom schedule and curriculum, tailored to your team.

Book a private cohort

$495

USD

Jun 30
Enroll