Featured

No Vibes, Just Evals: AI Frameworks for PMs

Hosted by Jason P. Yoong and Shankha Dey

Fri, Mar 20, 2026

8:30 PM UTC (30 minutes)

Virtual (Zoom)

Free to join

5,667 students

Invite your network

Go deeper with a course

Get Promoted Faster: For ICs & Managers
Jason P. Yoong
View syllabus

What you'll learn

Know if your AI feature is actually working before shipping

Define success before you build. A practical evaluation method you can use on any project.

Why AI requirements are nothing like software requirements

Stop writing feature specs, instead use behavior parameters to encode judgment before you build.

The autonomy decision (live demo of a real product)

How to design what the AI controls vs. what the human controls — use the "Autonomy Map" before architecture.

Why this topic matters

AI features can look “done” and still fail users in production. This talk gives PMs battle-tested frameworks to evaluate quality before launch, write AI-native requirements, and make the hard call on what the model automates vs. what humans control — so you ship value (not surprises). Includes a live demo of a real product built.

You'll learn from

Jason P. Yoong

Co-Founder & COO at Level Up (Prev: Amazon, Dentsu, IPG, Startup - $8M seed)

Over the past 15+ years, I’ve run $1B+ organizations in eCommerce, advertising, media, and marketplaces — led 40+ person teams, owned P&L, and managed $400M+ marketing budgets that delivered measurable growth and ROI.


At Amazon, Dentsu Aegis, and Universal McCann (IPG), I operated at global scale. Later, as a founding team member of a venture-backed software startup, I helped raise $8M in seed funding and built the go-to-market motion from zero to traction.


Today, I am the Cofounder & COO of Level Up, a career acceleration platform with 250,000+ followers. Alongside Ethan Evans (retired Amazon VP), we combine executive coaching, leadership courses, weekly newsletter, an engaged community, and custom AI GPT tools to help ambitious professionals grow faster, avoid mistakes, and make better career moves.


I also serve on the Harvard Business Review (HBR) advisory council and as a mentor at First Round Capital and Techstars.


Follow Jason on LinkedIn.


>> My next course Get Promoted Faster: For ICs & Managers (starts April 25; rated 4.9/5; designed for go getters < 15 years experience)

Shankha Dey

Sr Director PM @ Salesforce | ex-Microsoft Bing & Copilot | Columbia CS

Currently Sr. Director PM at Salesforce Data+AI leading Agentic Enterprise Search. Built the evaluation and data labeling infrastructure for Microsoft Turing (GPT-2 equivalent model) — powers 100M+ users in Copilot. Led AI platform across Bing, Cortana (now Copilot), Microsoft Search & Assistant.


15+ years shipping AI at planet scale across consumer and enterprise. MS Computer Science, Columbia University. Founded a visual search startup 5 years before Google Lens.


Follow on LinkedIn.

Senior leaders and advisors at

Salesforce
Microsoft
Amazon
Dentsu
Techstars

Sign up to join this lesson

By continuing, you agree to Maven's Terms and Privacy Policy.