Redesign Your Product Metrics for AI Evals
Hosted by Shane Butler
Wed, Dec 17, 2025
9:00 PM UTC (30 minutes)
Virtual (Zoom)
Free to join
By continuing, you agree to Maven's Terms and Privacy Policy.
Wed, Dec 17, 2025
9:00 PM UTC (30 minutes)
Virtual (Zoom)
Free to join
What you'll learn
Understand How Product Data Science Traditionally Evaluates
Identify Why Traditional Methods Break for AI Features
Apply a New Simple Mental Model for Evaluating AI Features
Why this topic matters
You'll learn from
Shane Butler
Principal Data Scientist, AI Evaluations at Ontra
Shane Butler is a Principal Data Scientist at Ontra, where he leads evaluation strategy for AI product development in the legal tech domain. He has more than ten years of experience in product data science and causal inference, with prior roles at Stripe, Nextdoor, and PwC. His current work focuses on practical, end-to-end methods for evaluating AI features in production. Shane is also the co-host of the AI podcast Data Neighbor, where he interviews product, data, and engineering leaders who are pioneering the next generation of data science and analytics in an AI-driven landscape.
Previously at Stripe, Nextdoor, PwC
By continuing, you agree to Maven's Terms and Privacy Policy.
