AB Testing for Data Scientists & Product Managers

Cohort-based Course

Learn to design A/B tests that drive real product decisions - from metrics and hypotheses to business impact.

Previously at

Google
Axtria
University of Cincinnati
Walmart
MIT research group

Course overview

Learn to Design and Analyze A/B Tests that Influence Product Strategy.

This weekend workshop is a hands-on introduction to A/B Testing designed specifically for data scientists and product managers. To truly drive impact, you must connect experiment results to business decisions, collaborate effectively with product stakeholders, and communicate findings in ways that influence roadmaps. This workshop is designed to help mid-senior data professionals build exactly those skills, sharpening your product thinking and transforming how you approach experimentation.


This course offers a practical, fast-paced dive into real-world experimentation.


Through interactive case-studies, group discussions, and live walkthroughs of industry tests, you will learn how to:

1) Frame hypotheses that lead to actionable decisions, not just statistical tests

2) Choose metrics that reflect business trade-offs — primary, secondary, and guardrails

3) Interpret test results in business terms, beyond just “stat sig”

4) Communicate insights clearly to PMs, leadership, and cross-functional teams


By the end, you won’t just be running A/B tests — you’ll be driving better product decisions with them.


We will wrap up the discussion by learning about what separates a good data scientist from a great one, and how you can continue building on your data skills.

Who this course is for:

01

Data scientists who want to build A/B Testing skills to share business outcomes and get interview-ready.

02

Growth analysts looking to design high-impact experiments and optimize key funnel metrics.

03

Product Managers who work closely with data teams and want to better frame, interpret and act on experiment results.

What you’ll get out of this course

Design high-signal A/B tests by framing clear hypotheses and selecting the right success and guardrail metrics aligned with product goals.

Give students an idea of how they can expect to grow throughout your course. Include specificity and precise results so students can benchmark exactly what they’ll learn.

Evaluate the impact of test results using confidence intervals, lift, and directional trade-offs to recommend feature launch decisions.

Give students an idea of how they can expect to grow throughout your course. Include specificity and precise results so students can benchmark exactly what they’ll learn.

Analyze real-world case studies from Uber and Spotify to learn the applications of AB Tests to industry challenges.

Give students an idea of how they can expect to grow throughout your course. Include specificity and precise results so students can benchmark exactly what they’ll learn.

Create a clear decision brief that translates experiment results into business-relevant insights for PMs, engineers, and leadership.

Give students an idea of how they can expect to grow throughout your course. Include specificity and precise results so students can benchmark exactly what they’ll learn.

Apply a reusable A/B testing framework to critique and improve existing experiment setups based on product context and goals.

Learn a practical framework to evaluate real-world A/B tests, identify weak hypotheses, misaligned metrics, and missed opportunities based on product intent.


What’s included

Live sessions

Learn directly from Manisha Arora & Banani Mohapatra in a real-time, interactive format.

Lifetime access

Go back to course content and recordings whenever you need to.

Community of peers

Stay accountable and share insights with like-minded professionals.

Certificate of completion

Share your new skills with your employer or on LinkedIn.

Maven Guarantee

This course is backed by the Maven Guarantee. Students are eligible for a full refund up until the halfway point of the course.

Course syllabus

2 live sessions • 22 lessons

Week 1

Aug 23—Aug 24

    Module 1 - A/B Testing for Data Scientists: From Metrics to Product Impact

    • Aug

      23

      Day 1: Foundations of Experimentation

      Sat 8/233:00 PM—5:00 PM (UTC)
    3 more items

    Module 2: Designing Experiments that Matter

    4 items

    Module 3: From Numbers to Decisions

    • Aug

      23

      Day 2: Influencing Decision-Making and Driving Outcomes

      Sat 8/234:00 PM—5:00 PM (UTC)
    4 more items

    Module 4: Driving Innovation through Experimentation

    4 items

    Module 5: What Makes a Great Product DS?

    4 items

    Module 6: What’s Next in Your Product DS Journey?

    3 items

What people are saying

        I have learnt more from Manisha through her courses than I have learnt in my 4-year college degree. I wish I had found her earlier.
Abhigna Pebbati

Abhigna Pebbati

Analytics & Data Science Manager, Meta
        I attended PrepVector's Product Data Science course and it was immensely helpful in developing a thought process for approaching open ended problems. Manisha was very supportive and advised me throughout my upskilling journey. I highly recommend her course."
Ketki Sharma

Ketki Sharma

Data Scientist, Dropbox
        I learnt from Manisha about how to think about problems in a structured manner. This helped me not just in my interviews as a candidate but also as an interviewer. The thought process developed in her course now helps me evaluate candidates better.
Vedhanarayan Ravi

Vedhanarayan Ravi

Data Scientist, Adobe
        Manisha's mentorship combined with well structured program and active discussions of practical case studies, played a significant part in elevating my approach and delivery of data science projects. She fostered a supportive, safe and inclusive environment that elevated the quality of discussions. It is a great course to level up your DS skills.
Indu Seetharaman

Indu Seetharaman

Data Scientist, Frost Bank

Meet your instructor

Manisha Arora

Manisha Arora

Data Science Lead, Google | Founder, PrepVector | MIT, UT Austin & Univ of Cinc

I am a seasoned Data Science professional with 12+ years of experience leading data science teams and driving business growth through data-driven decision making.


I currently lead the Data Science team at Google Ads, working closely with some of the largest advertisers to drive direct $$ to Google.


I am passionate about democratizing data science and enabling others level up in their careers. I found PrepVector to enable aspiring professionals to excel in there data science careers. I have taught 350+ data professionals through my courses at Maven & PrepVector.

Banani Mohapatra

Banani Mohapatra

Senior Manager, AI/ML & Data Science at Walmart | Generative AI,LLM | IIT Delhi

I am a Data Science Product Leader with 13+ years of experience in e-commerce, payments, and real estate, specializing in transforming data into actionable insights. I am passionate about teamwork and collaboration, I excel at bringing cross-functional teams together to deliver impactful results.


My expertise lies in AB Testing and Causal Inference, and I use those skills at work everyday to drive Walmart+ business.


Excited to be teaching this course and share my learnings along the way!

A pattern of wavy dots

Be the first to know about upcoming cohorts

AB Testing for Data Scientists & Product Managers

Course schedule

 2 hours Sat, 2 hours Sunday

  • Day 1: Foundations of Experimentation

    11:00am - 1:00pm EST

    Learn how great experiments start—with the right questions. We’ll cover hypothesis framing, choosing the right metrics, and designing experiments that align with product goals. You’ll also explore real-world examples of good (and not-so-good) test design.

  • Day 2: Influence Decision-Making and Drive Outcomes

    1:00pm - 2:00pm EST

    We’ll dive into analyzing experiment outcomes, understanding tradeoffs, and handling ambiguous results. You’ll practice translating test results into product impact and learn how to communicate insights to influence decision-making.

Learning is better with cohorts

Learning is better with cohorts

Active hands-on learning

This course builds on live workshops and hands-on projects

Interactive and project-based

You’ll be interacting with other learners through breakout rooms and project teams

Learn with a cohort of peers

Join a community of like-minded people who want to learn and grow alongside you

Frequently Asked Questions

A pattern of wavy dots

Be the first to know about upcoming cohorts

AB Testing for Data Scientists & Product Managers