Experimentation in the AI Era: A Playbook from the Trenches

Part of The AI Evaluation Handbook

Hosted by Mirza Rahim Baig and Vishnukant Peddawad

Fri, Jul 3, 2026

5:30 PM UTC (1 hour)

Virtual (Zoom)

Free to join

Invite your network

Go deeper with a course

GenAI for Leadership
Mirza Rahim Baig
View syllabus

What you'll learn

Why traditional A/B testing falls short

See how GenAI breaks traditional testing frameworks through spillage, SUTVA failures, and constantly evolving models.

Design metrics for AI-driven development

Learn practical frameworks to design metrics and measure success even when AI treatments and feedback loops change.

Apply real-world mitigation playbooks

Walk through case studies from leading companies to learn practical fixes for GenAI experimentation challenges.

Why this topic matters

GenAI accelerates development, but traditional A/B testing wasn't built for evolving models, spillage, and SUTVA failures. Teams that can't adapt risk shipping AI features blind. We'll explore why old frameworks break down and share real case studies to help you design metrics that turn GenAI from unpredictable noise into measurable growth.

You'll learn from

Mirza Rahim Baig

16 yrs AI & Data, 3x Author, Mentor

 Mirza Rahim Baig is the founder of Baig Academy, an AI and data practitioner, and the author of three books on applying AI in real organizations. He works with enterprise teams across Europe and the GCC region and keeps seeing the same experimentation failures repeat as GenAI features ship faster than measurement practices can catch up. He built this session to close that gap.

Vishnukant Peddawad

Product & Data Analytics Leader with 12+ years driving growth.

Senior Product & Data Analytics Leader | Delivering Revenue Growth via CRM, A/B Testing & Customer Journey Insights | SQL | Python | Tableau | Cloud (AWS, GCP) | Ex-Idealo, Ex-CME Group

Zalando
Flipkart
IU International University of Applied Sciences
IQVIA
See all products from Baig

Sign up to join this lesson

By continuing, you agree to Maven's Terms and Privacy Policy.