Beyond Vibe Prompting: The AI PM Playbook

Cohort-based Course

Learn to build, evaluate, and ship successful AI products with real-world frameworks and hands-on experience and become an AI product leader

Product at Spotify, Arize, Apple, Cruise

Life at Spotify
Arize AI
Apple
Cruise

Course overview

Design, prototype, and ship AI-powered products that delight customers

🚨 Independent offering. This course is not affiliated with, endorsed by, or related to any of the instructor’s current or past employers.


Transform from an AI-curious PM to a confident AI product leader who ships real solutions in 4 weeks

Are you a product manager with basic AI knowledge but struggling to turn concepts into actual products?


Maybe you've wondered...


1. How do I know if my AI product is actually performing well when? How do I measure impact?


2. If I change the model or prompt, how do I ensure I'm not breaking something else?


3. Why do my AI prototypes impress in demos but break with real users?


4. How do I translate AI buzzwords (RAG, MCP) into actual product features my team can build?


5. What separates AI products that ship successfully (i.e. Cursor, Bolt) from those that suck?


6. How do I get my team on board to evaluate AI products when success is subjective and context-dependent?


Does this sound familiar?


- You've got the AI buzzwords down. You've built impressive demos. You've read all the blogs about prompt engineering.

But when it comes to actually shipping AI products that customers love? You hit a wall.


- Your stakeholders want an "AI strategy" but can't articulate what success looks like. Your demos wow executives but break under real-world conditions. You've got no reliable way to measure if your AI is actually performing well or just getting lucky.


- While your peers struggle with the same challenges, the rare PMs who consistently ship successful AI products are becoming the most valuable players in their organizations.


You're not alone. While many PMs understand AI fundamentals, there's a massive gap between knowing buzzwords and successfully shipping AI solutions that solve real problems.


---


WHAT TO EXPECT


This course will provide you with hands-on experience. Get ready to build real tools, evaluation frameworks, and develop implementation plans! I'll also host a dedicated Slack community where you can communicate with me and other participants. All sessions will be recorded and available to students asynchronously.


1. Transform your role – Evolve from an AI-curious PM to a confident AI product leader who ships real, customer-loved solutions.


2. Bridge the “buzzword → shipping” gap – Move beyond knowing RAG, agents, and LLMs to deploying features that solve actual problems.


3. 4-week live sprint – Eight interactive sessions packed with vibe-coding labs, eval workshops, and peer feedback loops.


4. Built by a practitioner – Learn the playbook I used at Arize AI (supports companies like Uber, Instacart, Discord) and Spotify to help hundreds of engineers launch AI-powered products.


5. Hands-on from day one – You’ll prototype, measure, harden, and ship—not just watch slides.


6. Career-defining skill set – Master the tactics that separate PMs who stall in experimentation from those who deliver measurable business impact.


This is not a theoretical course about AI concepts—it's a practical roadmap for product managers who want to go from "I understand what RAG is" to "I shipped an AI product that customers love." Over 4 weeks of hands-on, interactive sessions, you'll bridge the gap between AI knowledge and shipping success.


AFTER THIS COURSE:


1. Build and deploy functional AI agents for your personal and team workflows


2. Define Your H1/H2 AI Roadmap. Lead AI product strategy with confidence and credibility


2. Evaluate AI product performance with robust metrics beyond simple accuracy


3. Take prototypes to production with clear implementation plans


4. Collaborate effectively with AI engineers, executives and stakeholders. Learn how to identify great AI PMs.

Who is this course for

01

Product Managers familiar with AI terms and concepts (LLMs, RAG, etc.) that wants to move beyond prompting to building actual AI products

02

Technical PMs transitioning to AI-focused roles who see AI product leadership as their career differentiator in the next 1-2 years

03

Product Leaders and Executives responsible for AI strategy who need practical frameworks for evaluating and implementing AI initiatives

What makes this course unique

Learn by building - Live during the lesson

Create real AI agents and products you can use immediately—no theoretical exercises. You'll master the techniques needed to build agents that solve real problems and continuously improve over. We'll be using low code tools like Bolt, Replit and write code with Cursor

Apply immediately to your work

Each lesson includes templates and frameworks you can use the next day at your job. Learn the end-to-end process for taking AI products from concept to shipping success, including agent building, evaluation frameworks, implementation planning, and product strategy.

Focus on the full lifecycle

Move from prototype to production with detailed guidance on what changes when scaling AI. You'll learn strategies for maintaining quality at scale with evals while managing cost, latency, and performance constraints.

Master evals as a PM

 Learn the critical skill of designing and implementing evals that CPOs at OpenAI and Anthropic identify as essential. While everyone else is obsessing over prompts, I'll show you why evaluation frameworks are the true differentiator in AI product development.

Develop AI product intuition

Analyze the best AI products on the market to identify patterns that create exceptional experiences. You'll develop frameworks for identifying high-value AI opportunities and aligning your organization around AI.

Built by someone shipping real AI products right now

This isn't theory from someone who "used to" build AI products. I'm actively working with companies like Uber and Instacart to implement and improve their AI systems. Everything I teach comes from the frontlines of AI product building.

Community of peers

Connect with like-minded professionals transitioning into AI product roles, creating a valuable network for future collaboration.

This course includes

Interactive live sessions

Lifetime access to course materials

6 in-depth lessons

Direct access to instructor

Projects to apply learnings

Guided feedback & reflection

Private community of peers

Course certificate upon completion

Maven Satisfaction Guarantee

This course is backed by Maven’s guarantee. You can receive a full refund within 14 days after the course ends, provided you meet the completion criteria in our refund policy.

Course syllabus

Week 1

Jul 1—Jul 6

    Session 1: Building Your First AI Agent (Live Workshop)

    1 item

    Session 2: Developing AI Product Intuition

    1 item

Week 2

Jul 7—Jul 13

    Session 3: Building Comprehensive Eval Frameworks

    1 item

    Session 4: Evals in Action (Hands-on Workshop)

    1 item

Week 3

Jul 14—Jul 20

    Session 5: From Prototype to Production: Building AI-Specific PRDs

    1 item

    Session 6: Guest Lecture from an AI Product Leader

    1 item

Week 4

Jul 21—Jul 22

    Session 7: Developing Your AI Product Strategy

    0 items

    Session 8: Wrap up + Q&A

    0 items

❌ Who This Course Is Not For

01

PMs seeking theoretical knowledge without practical application or immediate implementation

02

Complete AI Beginners: While we cover fundamentals, you should have some familiarity with basic AI concepts and terminology before joining.

03

PMs seeking silver bullets without committing to the structured evaluation and iteration process required for successful AI products

A pattern of wavy dots

This is not a theoretical AI course.


You'll walk away with practical frameworks, hands-on experience, and a portfolio of work that demonstrates your capabilities as an AI product leader.


Meet your instructor

Aman Khan

Aman Khan

Aman has worked as a product leader at Arize AI, Spotify, Cruise, Zipline, and Apple.


Currently, Aman is Director of Product at Arize AI, an AI Development platform used by companies like Uber, Duolingo, Reddit, Instacart, and Booking.com. At Arize, Aman helps teams launch and improve their AI systems. He recently led a popular deeplearning.ai course on Evaluating AI Agents.

A pattern of wavy dots

Be the first to know about upcoming cohorts

Beyond Vibe Prompting: The AI PM Playbook

Course schedule

3-4 hours per week

  • Tuesdays & Thursdays

    2 hours per week

    We will have sessions twice a week for 4 weeks until the last week, for a total of 7 sessions.

  • Weekly projects

    There will be assignments after each session to reinforce what you learned in the lesson.

Free resource

Evaluating AI Agents

Learn more about evaluating agents with this hands on course in partnership with Deeplearning.ai

Access this free course!

A pattern of wavy dots

Be the first to know about upcoming cohorts

Beyond Vibe Prompting: The AI PM Playbook

Frequently Asked Questions