AI Fundamentals

Apply AI in your role

Career Development

Career development

Craft

Product

Engineering

Design

Marketing

Leadership fundamentals

Leadership

Founders

By Role

More

Transform from consumer of analytics to independent operator - asking sharp questions, validating answers, shipping decisions.

Principal Data Scientist @ Ontra 

Stripe

Nextdoor

PwC India

Ontra

AppFolio

Shane Butler

Principal Data Scientist @ Ontra | Ex-Stripe, Nextdoor, PwC, Appfolio

Data Science Leader |Ex-Microsoft

Microsoft

eBay

Grammarly

Superhuman

Sravya Madipalli

Data Science Leader@Superhuman (Prev. Grammarly)| Ex-Microsoft, eBay, Nextdoor

Head of Data @ Ontra AI | Ex-LinkedIn

LinkedIn

Pinterest

Hai Guan

Head of Data @ Ontra | Ex-Nextdoor, LinkedIn, Pinterest, Meta

Cohort 1

The future belongs to full-stack builders, not narrow specialists. As AI reduces the value of deep domain silos, the people who thrive will be the ones who can work across disciplines and ship.You can already prototype designs, write code, and generate content with AI. But analytical independence - the ability to validate your own ideas and make data-informed decisions - remains the missing skill in most builders' toolkits.AI can conduct the analysis, but it can't tell you what to ask or whether the answer makes sense. That requires analytical judgment.This course teaches you to think like a senior Product Data Scientist. You'll learn the frameworks used at FAANG companies to frame problems, choose the right metrics, diagnose root causes, execute the analysis, and turn insights into decisions.-&gt; <a target="_blank" rel="noopener noreferrer nofollow" href="https://join.slack.com/t/dataneighbor/shared_invite/zt-3ox4drc3r-3g0ptSthytkgv0sD6ovvqg">Join AI Builders Slack Community!!</a> &lt;-What makes this different: No SQL. No stats lectures. Five weeks of hands-on real scenarios. You'll build a complete analytical case study - metric specs, deep dives, experiment plans, stakeholder readouts.The result: You become analytically self-sufficient. The last dependency removed from your toolkit. Make data-informed decisions in hours, not weeks.

Ask Better Questions, Make Faster Decisions - with AI as Your Analyst

Frame Problems Like a Senior Data Scientist

Design Metrics That Actually Drive Decisions

Diagnose Root Causes Without Guessing

Design Experiments That Ship

Turn Analysis Into Action With AI as Your Copilot

Synthesize Insights and Prioritize for Impact

Product Managers, engineers, and operators who need analytical independence and frameworks to measure success and drive decisions.

Designers and researchers stepping into strategy roles who need to quantify impact, run experiments, and influence with data-driven insights

Data professionals who want to frame better questions, delegate technical execution to AI, and drive impact with agentic analytics tools.

Learn from a world-leading expert how to design and analyze trustworthy A/B tests to evaluate ideas, integrate AI/ML, and grow your business

Author of best-selling A/B testing book

Airbnb

Amazon

Dr. Ronny Kohavi

Technical fellow and VP at Microsoft & Airbnb, co-author of A/B testing book

9 March 2026

1 June 2026

Through multiple real examples of well-run experiments and stories from Microsoft, Amazon, and Airbnb, you will see the humbling reality that we are terrible at assessing the value of ideas.Trivial changes can be surprisingly useful, whereas large efforts often fail. Accelerate innovation by building Minimum Viable Products (MVPs) and features, and make the organization more evidence-based and humble as it adopts and learns to use evidence from the gold standard in science—the controlled experiment.You will understand the challenges in designing and running trustworthy randomized controlled experiments (A/B tests), including the importance of the Overall Evaluation Criterion (OEC), scaling, common pitfalls, and Twyman's Law. We cover cultural challenges, institutional memory, maturity model, observational causal studies, offline evaluation, AI/Machine learning and triggering, build-vs-buy trade-offs, challenges, and requested topics. The Advanced Topics course is designed as a technical follow-on: <a target="_blank" rel="noopener noreferrer nofollow" href="https://bit.ly/AdvancedABFS">https://bit.ly/AdvancedABFS</a>

Empower your organization to be data-driven and innovative

Internalize the humbling reality: we are poor at assessing the value of ideas

Understand the key advantages and limitations of A/B testing

Learn how to design metrics and the Overall Evaluation Criterion

Learn how to design trustworthy A/B tests

Learn about the cultural challenges

Learn about the relationship to AI and Machine Learning Modeling

Data science managers and scientists will be able to design and interpret the experimental results in a trustworthy manner

Program managers focused on growth, revenue, conversions, and prioritization will understand how to provide the org with robust clear metric

Engineering leaders will be able to make organizations more data-driven and efficient with fewer severe incidents through A/B tests

Learn advanced A/B-testing topics from a world-leading expert. Ten topics in three days of 2 hours each.

⚠️ Warning: Advanced course 

23 March 2026

15 June 2026 - Advanced

We cover advanced topics not typically addressed in courses and books and leave significant time for interactions and Q&amp;A.Classes are small: typically ~15 live attendees. The course assumes you already took <a target="_blank" rel="noopener noreferrer nofollow" href="https://bit.ly/ABCourseRonKohavi">https://bit.ly/ABCourseRonKohavi</a> or have equivalent knowledge.

Improve your A/B testing capabilities and build trust

Improve your A/B Testing capabilities and trust

Discuss your own questions

Designed as a follow-on to the flagship course: https://maven.com/kohavi/abtesting. 

Take that course first, or have equivalent knowledge

Follow-on to flagship course

Good understanding of p-value misconceptions, statistical power, OEC.

Statistics of A/B Testing

Data science managers and scientists who understand the basics of A/B testing and want to better understand advanced topics

Product and program managers who want to advance their understanding of A/B testing

AI Fundamentals

Apply AI in your role

Career Development

AI Fundamentals

Career development

Craft

AI Fundamentals

Career development

Craft

AI Fundamentals

Career development

Craft

AI Fundamentals

Craft

AI Fundamentals

Leadership fundamentals

AI Fundamentals

Leadership fundamentals

By Role

Experimentation

Cohort-based courses

You may be interested in