Free Lesson

Experimentation in the AI Era: Lessons from the Trenches

Part of The AI Evaluation Handbook

Hosted by Mirza Rahim Baig and Vishnukant Peddawad

Fri, Jul 3, 2026

5:30 PM UTC (1 hour)

Virtual (Zoom)

Free to join

70 students

Invite your network

Go deeper with a course

Practical Data & AI Skills for PMs
Mirza Rahim Baig
View syllabus

What you'll learn

Why traditional A/B testing falls short

See how GenAI breaks traditional testing frameworks through spillage, SUTVA failures, and constantly evolving models.

How to measure success in AI-powered experiences

Learn practical frameworks to design metrics and measure success even when AI treatments and feedback loops change.

The future of experimentation: Adaptive & autonomous systems

Eliminate testing bottlenecks using bandits, AI-driven design, and continuous closed-loop learning.

Why this topic matters

GenAI accelerates code, but traditional testing creates a massive bottleneck. When model predictions constantly shape user behavior, and user feedback loops alter the model, static frameworks break down. Teams that can't adapt risk shipping blind. We'll explore why old methods fail and show you how to transition to the future of high-velocity, adaptive, and autonomous experimentation.

You'll learn from

Mirza Rahim Baig

16 yrs AI & Data, 3x Author, Mentor

 Mirza Rahim Baig is the founder of Baig Academy, an AI and data practitioner, and the author of three books on applying AI in real organizations. He works with enterprise teams across Europe and the GCC region and keeps seeing the same experimentation failures repeat as GenAI features ship faster than measurement practices can catch up. He built this session to close that gap.

Vishnukant Peddawad

Product & Data Analytics Leader with 12+ years driving growth.

Senior Product & Data Analytics Leader | Delivering Revenue Growth via CRM, A/B Testing & Customer Journey Insights | SQL | Python | Tableau | Cloud (AWS, GCP) | Ex-Idealo, Ex-CME Group

Zalando
Flipkart
IU International University of Applied Sciences
IQVIA
See all products from Baig

Sign up to join this lesson

By continuing, you agree to Maven's Terms and Privacy Policy.