Featured

No Vibes, Just Evals: Proven Frameworks for AI-Native PMs

Hosted by Jason P. Yoong and Shankha Dey

Fri, Mar 20, 2026

8:30 PM UTC (30 minutes)

Virtual (Zoom)

Free to join

5,855 students

Invite your network

Go deeper with a course

Get Promoted Faster: For ICs & Managers
Jason P. Yoong
View syllabus

What you'll learn

Define "good" before you write code

Evals are replacing prds. Learn the framework that tests judgement before launch.

Write behavior specs, not feature specs

AI doesn't execute instructions - it interprets them. Learn to encode judgment so your model does what you actually mean

Set your autonomy dial (live demo of real product)

Make decisions to govern judgement - what AI controls and what humans control, using an autonomy map.

Why this topic matters

Al features can look "done" and still fail users in production. AI-Native PMs fix this. They define success criteria, encode judgment into behavior specs, and decide autonomy levels for AI - before incidents happen in production. This talk gives PMs 3 battle-tested frameworks, the same principles used in industrial eval infrastructures that serve 100M+ users. (includes real product live demo)

You'll learn from

Jason P. Yoong

Co-Founder & COO at Level Up (Prev: Amazon, Dentsu, IPG, Startup - $8M seed)

Over the past 15+ years, I’ve run $1B+ organizations in eCommerce, advertising, media, and marketplaces — led 40+ person teams, owned P&L, and managed $400M+ marketing budgets that delivered measurable growth and ROI.


At Amazon, Dentsu Aegis, and Universal McCann (IPG), I operated at global scale. Later, as a founding team member of a venture-backed software startup, I helped raise $8M in seed funding and built the go-to-market motion from zero to traction.


Today, I am the Cofounder & COO of Level Up, a career acceleration platform with 250,000+ followers. Alongside Ethan Evans (retired Amazon VP), we combine executive coaching, leadership courses, weekly newsletter, an engaged community, and custom AI GPT tools to help ambitious professionals grow faster, avoid mistakes, and make better career moves.


I also serve on the Harvard Business Review (HBR) advisory council and as a mentor at First Round Capital and Techstars.


Follow Jason on LinkedIn.


>> My next course Get Promoted Faster: For ICs & Managers (starts April 25; rated 4.9/5; designed for go getters < 15 years experience)

Shankha Dey

Sr Director PM @ Salesforce | ex-Microsoft Bing & Copilot | Columbia CS

Currently Sr. Director PM at Salesforce Data+AI leading Agentic Enterprise Search. Built the evaluation and data labeling infrastructure for Microsoft Turing (GPT-2 equivalent model) — powers 100M+ users in Copilot. Led AI platform across Bing, Cortana (now Copilot), Microsoft Search & Assistant.


15+ years shipping AI at planet scale across consumer and enterprise. MS Computer Science, Columbia University. Founded a visual search startup 5 years before Google Lens.


Follow on LinkedIn.

Senior leaders and advisors at

Salesforce
Microsoft
Amazon
Dentsu
Techstars

Sign up to join this lesson

By continuing, you agree to Maven's Terms and Privacy Policy.