Prototype to Production: The AI PM Playbook

New
·

4 Weeks

·

Cohort-based Course

Build, evaluate, and ship successful AI products with real-world frameworks and hands-on experience to become an advanced AI product leader

This course is popular

4 people enrolled last week.

Product at Spotify, Arize, Apple, Cruise

Life at Spotify
Arize AI
Apple
Cruise

Course overview

Design, prototype, and ship AI-powered products that delight customers

🚨 Independent offering. This course is not affiliated with, endorsed by, or related to any of the instructor’s current or past employers.


This course is a practical roadmap for PMs who want to go from "I understand what RAG is" to "I shipped an AI product that customers love." Over 4 weeks of hands-on, interactive sessions, you'll bridge the gap between AI knowledge and shipping success.


This is best suited for PMs who have at least a theoretical grasp on the latest AI concepts (RAG, MCP, Evals) and who have played around with prototyping tools like Replit, Bolt but are looking to bring AI features from prototype to production inside their companies.


At the end of this course, you’ll leave able to: 


- Build and deploy functional AI agents for your personal and team workflows.


- Define Your H1/H2 AI Roadmap, and lead AI product strategy with confidence and credibility.


- Evaluate AI product performance with robust metrics beyond simple accuracy, or toxicity. After years of building AI products, I’ve noticed something surprising: every PM building with generative AI obsesses over crafting better prompts and using the latest LLM, yet almost no one masters the hidden lever behind every exceptional AI product: evaluations.


- Take prototypes to production with clear implementation plans.


- Collaborate effectively with AI engineers, executives and stakeholders. 


- Learn how to identify and hire great AI PMs for your team.


---


WHAT TO EXPECT


1. We’ll prototype an AI product (I.e. use code gen with Cursor / Replit + langgraph/crew) to build an agentic application/system, relevant to your work or life. If you don’t have an idea, I’ll provide one/walk through one. We’ll build it together.


2. We’ll breakdown how code gen agents work to understand the inner workings of an AI product/feature (main components).

Evals are the hidden lever behind every exceptional AI product. We’ll explore this in practice by running evals on your prototype and iterating on the prompt.


3. We’ll talk about best practices for getting to production, what to think about when you have real user data, how to work together with an AI team. 


4. We’ll turn your prototype + eval system + learnings into an “AI strategy doc/artifact” that you could use to convey this ai feature to others on your team/stakeholders


---


This course will be very hands-on – you’ll build real tools, evaluation frameworks, and develop implementation plans! 


- 4 week live sprint: 8 interactive live sessions packed with vibe-coding labs, eval workshops, and peer feedback loops

All sessions will be recorded and available to students asynchronously.


- Built by and led by a current practitioner – I’m sharing the playbook I use as Head of Product at Arize AI (supports companies like Uber, Instacart, Discord, Reddit) and Spotify to help hundreds of engineers launch AI-powered products.


- I'll also host a dedicated Slack community where you can communicate with me and other participants. 


- All sessions will be recorded and available to students asynchronously.


This is not a theoretical course about AI concepts—it's a practical roadmap for product managers who want to go from "I understand what RAG is" to "I shipped an AI product that customers love." Over 4 weeks of hands-on, interactive sessions, you'll bridge the gap between AI knowledge and shipping success.

Who is this course for

01

Product Managers familiar with AI terms and concepts (LLMs, RAG, etc.) that wants to move beyond prompting to building actual AI products

02

Technical PMs transitioning to AI-focused roles who see AI product leadership as their career differentiator in the next 1-2 years

03

Product Leaders and Executives responsible for AI strategy who need practical frameworks for evaluating and implementing AI initiatives

Prerequisites

  • Familiarity with code

    We'll help you get Cursor set up, but some familiarity with coding/debugging will go a long way here (i.e. being able to read python code)

What makes this course unique

Hands-On Learning in a Limited-Size Cohort

This course will be focused on outcomes. I've intentionally limited enrollment to ensure personalized attention during live building sessions, direct feedback on your specific AI product challenges, and meaningful connections with fellow AI-focused PMs.

Learn by building - Live during the lesson

Create real AI agents and products you can use immediately—no theoretical exercises. You'll master the techniques needed to build agents that solve real problems and continuously improve over. We'll be using low code tools like Bolt, Replit and write code with Cursor

Apply immediately to your work

Each lesson includes templates and frameworks you can use the next day at your job. Learn the end-to-end process for taking AI products from concept to shipping success, including agent building, evaluation frameworks, implementation planning, and product strategy.

Focus on the full lifecycle

Move from prototype to production with detailed guidance on what changes when scaling AI. You'll learn strategies for maintaining quality at scale with evals while managing cost, latency, and performance constraints.

Master evals as a PM

 Learn the critical skill of designing and implementing evals that CPOs at OpenAI and Anthropic identify as essential. While everyone else is obsessing over prompts, I'll show you why evaluation frameworks are the true differentiator in AI product development.

Develop AI product intuition

Analyze the best AI products on the market to identify patterns that create exceptional experiences. You'll develop frameworks for identifying high-value AI opportunities and aligning your organization around AI.

Built by someone shipping real AI products right now

This isn't theory from someone who "used to" build AI products. I'm actively working with companies like Uber and Instacart to implement and improve their AI systems. Everything I teach comes from the frontlines of AI product building.

Community of peers

Connect with like-minded professionals transitioning into AI product roles, creating a valuable network for future collaboration.

What’s included

Aman Khan

Live sessions

Learn directly from Aman Khan in a real-time, interactive format.

Lifetime access

Go back to course content and recordings whenever you need to.

Community of peers

Stay accountable and share insights with like-minded professionals.

Certificate of completion

Share your new skills with your employer or on LinkedIn.

Maven Guarantee

This course is backed by the Maven Guarantee. Students are eligible for a full refund up until the halfway point of the course.

Course syllabus

11 live sessions • 22 lessons • 6 projects

Week 1

Jul 1—Jul 6

    Jul

    2

    Session 1: Building Your First AI Agent (Live Workshop)

    Wed 7/21:00 AM—2:00 AM (UTC)

    Session 1: Building Your First AI Agent (Live Workshop)

    6 items

    Jul

    4

    Session 2: Developing AI Product Intuition

    Fri 7/41:00 AM—2:00 AM (UTC)

    Session 2: Developing AI Product Intuition

    6 items

    Jul

    4

    Optional: Office hours + Live Working Time #1

    Fri 7/42:00 AM—2:30 AM (UTC)
    Optional

Week 2

Jul 7—Jul 13

    Jul

    9

    Session 3: Building Comprehensive Eval Frameworks

    Wed 7/91:00 AM—2:00 AM (UTC)

    Session 3: Building Comprehensive Eval Frameworks

    5 items

    Jul

    11

    Session 4: Optimizing Evals in Action (Hands-on Workshop)

    Fri 7/111:00 AM—2:00 AM (UTC)

    Session 4: Evals in Action (Hands-on Workshop)

    4 items

    Jul

    11

    Optional: Office hours + Live Working Time #2

    Fri 7/111:00 AM—1:30 AM (UTC)
    Optional

Week 3

Jul 14—Jul 20

    Jul

    16

    Session 5: From Prototype to Production: Building AI-Specific PRDs

    Wed 7/161:00 AM—2:00 AM (UTC)

    Session 5: From Prototype to Production: Building AI-Specific PRDs

    4 items

    Jul

    18

    Session 6: Guest Lecture from an AI Product Leader

    Fri 7/181:00 AM—2:00 AM (UTC)

    Session 6: Guest Lecture from an AI Product Leader

    1 item

    Jul

    18

    Optional: Office hours + Live Working Time #1

    Fri 7/182:00 AM—2:30 AM (UTC)
    Optional

Week 4

Jul 21—Jul 27

    Session 7: (Interactive) Refine Your AI Product Strategy

    1 item

    Jul

    23

    Session 7: (Interactive) Refine Your AI Product Strategy

    Wed 7/231:00 AM—2:00 AM (UTC)

    Session 8: Wrap up + Q&A

    1 item

    Jul

    25

    Session 8: Wrap up + Q&A

    Fri 7/251:00 AM—2:00 AM (UTC)

❌ Who This Course Is Not For

01

PMs seeking theoretical knowledge without practical application or immediate implementation

02

Complete AI Beginners: While we cover fundamentals, you should have some familiarity with basic AI concepts and terminology before joining.

03

PMs seeking silver bullets without committing to the structured evaluation and iteration process required for successful AI products

A pattern of wavy dots

This is not a theoretical AI course.


You'll walk away with practical frameworks, hands-on experience, and a portfolio of work that demonstrates your capabilities as an AI product leader.


Meet your instructor

Aman Khan

Aman Khan

Aman has worked as a product leader at Arize AI, Spotify, Cruise, Zipline, and Apple.


Currently, Aman is Director of Product at Arize AI, an AI Development platform used by companies like Uber, Duolingo, Reddit, Instacart, and Booking.com. At Arize, Aman helps teams launch and improve their AI systems. He recently led a popular deeplearning.ai course on Evaluating AI Agents, and has been featured by Lenny's Newsletter to cover AI Product Management a number of times.

A pattern of wavy dots

Join an upcoming cohort

Prototype to Production: The AI PM Playbook

Cohort 1

$1,899

Dates

July 2—28, 2025

Payment Deadline

June 30, 2025
Get reimbursed

Course schedule

3-4 hours per week

  • Tuesdays & Thursdays

    2 hours per week

    We will have sessions twice a week for 4 weeks until the last week, for a total of 7 sessions.

  • Weekly projects

    There will be assignments after each session to reinforce what you learned in the lesson.

Free resource

Evaluating AI Agents

Learn more about evaluating agents with this hands on course in partnership with Deeplearning.ai

Access this free course!

Go from Beginner to Advanced AI PM

Go from Beginner to Advanced AI PM

Frequently Asked Questions

Learn from the bleeding edge of AI PM

What people are saying

        For any AI product manager, truly effective collaboration with AI engineers and the ability to navigate the intricacies of evals are non-negotiable, and Aman's course provides that crucial foundation.
Hamel Husain

Hamel Husain

Evals Expert
A pattern of wavy dots

Join an upcoming cohort

Prototype to Production: The AI PM Playbook

Cohort 1

$1,899

Dates

July 2—28, 2025

Payment Deadline

June 30, 2025
Get reimbursed

$1,899

4 Weeks