Featured

Battle-Tested Frameworks for AI Evals and Requirements

Hosted by Jason P. Yoong and Shankha "Shubho" Dey

Fri, Mar 20, 2026

8:30 PM UTC (30 minutes)

Virtual (Zoom)

Free to join

Invite your network

Go deeper with a course

Get Promoted Faster: For ICs & Managers
Jason P. Yoong
View syllabus

What you'll learn

Know if your AI feature is actually working before shipping

A practical evaluation method you can use on any project

Why AI requirements are nothing like software requirements

Framework top AI PMs use to write them

The autonomy decision (live demo of a real product)

How to design what the AI controls vs. what the human controls

Why this topic matters

AI features can look “done” and still fail users in production. This talk gives PMs battle-tested frameworks to evaluate quality before launch, write AI-native requirements, and make the hard call on what the model automates vs. what humans control — so you ship value (not surprises). Includes a live demo of a real product built.

You'll learn from

Jason P. Yoong

Co-Founder & COO at Level Up (Prev: Amazon, Dentsu, IPG, Startup - $8M seed)

Over the past 15+ years, I’ve run $1B+ organizations in eCommerce, advertising, media, and marketplaces — led 40+ person teams, owned P&L, and managed $400M+ marketing budgets that delivered measurable growth and ROI.


At Amazon, Dentsu Aegis, and Universal McCann (IPG), I operated at global scale. Later, as a founding team member of a venture-backed software startup, I helped raise $8M in seed funding and built the go-to-market motion from zero to traction.


Today, I am the Cofounder & COO of Level Up, a career acceleration platform with 250,000+ followers. Alongside Ethan Evans (retired Amazon VP), we combine executive coaching, leadership courses, weekly newsletter, an engaged community, and custom AI GPT tools to help ambitious professionals grow faster, avoid mistakes, and make better career moves.


I also serve on the Harvard Business Review (HBR) advisory council and as a mentor at First Round Capital and Techstars.


Follow Jason on LinkedIn.


>> My next course Get Promoted Faster: For ICs & Managers (starts April 25; rated 4.9/5; designed for go getters < 15 years experience)

Shankha "Shubho" Dey

Sr Director, Product @Salesforce Data+AI. Ex- Cortana, Bing, Microsoft Search.

Program and Product executive interested in helping near or post IPO companies build new products and businesses. Hands-on leadership of top level company objectives with cross-division GMs and C-suite. Investor in various early to mid stage companies.


Built and marketed planet-scale products and platforms at Microsoft and Salesforce: Enterprise and Consumer Search, Conversational AI, Voice AI. Founded a visual search startup 5 years before Google Lens, and previously worked as an engineer in computer security and finance. Worked on data labeling and evals for Microsoft Turing (GPT-2 equivalent) model.


Follow Shankha on LinkedIn.

Senior leaders and advisors at

Salesforce
Microsoft
Amazon
Dentsu
Techstars

Sign up to join this lesson

By continuing, you agree to Maven's Terms and Privacy Policy.