Course

AI Eval Frameworks for UX and Product Teams

Melissa Wittmayer

Design Leader for agentic UX & evals

Design AI evals that measure what matters.

Agentic AI has changed what designers and product builders need to own. Evals are critical to building reliable agents, but teams often benchmark agents against how humans perform a task without first understanding what makes the experience successful.

This hands-on cohort will guide you from understanding the problem you're solving to identifying meaningful agent behaviors, designing cost-effective evaluations, and turning results into product decisions.

What you’ll learn

Create a working evaluation practice grounded in user needs, meaningful behavior rubrics, a running evaluator, and a plan for action.

  • Learn how to think in workflows

  • Map out how your agent, systems, and humans work towards a goal together

  • Run workshops with your team to surface risks

  • Create an eval framework that optimizes the user experience

  • Design cost-effective evaluators that focus on what matters most

  • Identify measurable behaviors

  • Build a rubric you can trust

  • Design cost-effective evaluators that focus on what matters most

  • Diagnose the root causes behind agent failures

  • Establish shared eval practices for your team

Learn directly from Melissa

Melissa Wittmayer

Melissa Wittmayer

Contact

Design Leader for agentic UX & evals, speaker, writer

See all products from Melissa

Who this course is for

  • Designers or PMs trying to understand how to turn eval insights into solutions that improve the overall experience.

  • Product teams looking for ways to turn evals into a team practice.

  • Design leaders who want to support their teams by creating eval practices grounded by UX.

What's included

Melissa Wittmayer

Live sessions

Learn directly from Melissa Wittmayer in a real-time, interactive format.

Lifetime access

Go back to course content and recordings whenever you need to.

Community of peers

Stay accountable and share insights with like-minded professionals.

Certificate of completion

Share your new skills with your employer or on LinkedIn.

Maven Guarantee

Your purchase is backed by the Maven Guarantee.

Course syllabus

4 live sessions • 12 lessons • 4 projects

Week 1

Nov 9—Nov 15

    Module 1: Building Agent Experiences

    • Nov

      9

      Session 1

      Mon 11/98:00 PM—9:00 PM (UTC)
    4 more items

    Module 2: Anticipating Failures

    • Nov

      13

      Session 2

      Fri 11/138:00 PM—9:00 PM (UTC)
    3 more items

Week 2

Nov 16—Nov 20

    Module 3: Identifying Measurable Behaviors

    • Nov

      16

      Session 3

      Mon 11/168:00 PM—9:00 PM (UTC)
    5 more items

    Module 4: Evals as a Practice

    • Nov

      20

      Session 4

      Fri 11/208:00 PM—9:00 PM (UTC)
    4 more items

Schedule

Live sessions

2 hrs / week

    • Mon, Nov 9

      8:00 PM—9:00 PM (UTC)

    • Fri, Nov 13

      8:00 PM—9:00 PM (UTC)

    • Mon, Nov 16

      8:00 PM—9:00 PM (UTC)

    • Fri, Nov 20

      8:00 PM—9:00 PM (UTC)

Projects

1 hr / week

Async content

2 hrs / week

Frequently asked questions

Maven for Teams

Reimbursement

Get your company to pay

Everything L&D needs: email template, receipts, and certificate of completion.

Get reimbursed

Team discount

Learn with your teammates

Save 20%+ when 2 or more teammates enroll in the same cohort.

Save 20%+ with a team

Private cohort

Run a cohort for your org

A dedicated cohort with a custom schedule and curriculum, tailored to your team.

Book a private cohort

$750

USD

Nov 9—Nov 20
Enroll