Design Experiments for AI Features
Hosted by Shane Butler
Thu, Feb 19, 2026
8:00 PM UTC (1 hour)
Virtual (Zoom)
Free to join
Go deeper with a course

Thu, Feb 19, 2026
8:00 PM UTC (1 hour)
Virtual (Zoom)
Free to join
142 students
Go deeper with a course

What you'll learn
Where experiments fit in the AI impact chain
Define exposure and randomization correctly
Know when results are decision-grade
Join AI Builders Slack Community. Link: bit.ly/ai-connect
Why this topic matters
You'll learn from
Shane Butler
Principal Data Scientist, AI Evaluations at Ontra
Shane Butler is a Principal Data Scientist at Ontra, where he leads evaluation strategy for AI product development in the legal tech domain. He has more than ten years of experience in product data science and causal inference, with prior roles at Stripe, Nextdoor, and PwC. His current work focuses on practical, end-to-end methods for evaluating AI features in production. Shane is also the co-host of the AI podcast Data Neighbor, where he interviews product, data, and engineering leaders who are pioneering the next generation of data science and analytics in an AI-driven landscape.
Previously at Stripe, Nextdoor, PwC
