Choose the Right AI Evals Vendor

Hosted by Stella Liu and Amy Chen

Mon, Dec 1, 2025

4:00 PM UTC (30 minutes)

Virtual (Zoom)

Free to join

By continuing, you agree to Maven's Terms and Privacy Policy.

Invite your network

Go deeper with a course

AI Evals and Analytics Playbook

Stella Liu and Amy Chen

View syllabus

Mon, Dec 1, 2025

4:00 PM UTC (30 minutes)

Virtual (Zoom)

Free to join

Invite your network

Go deeper with a course

AI Evals and Analytics Playbook

Stella Liu and Amy Chen

View syllabus

What you'll learn

When and Why to Adopt an AI Evals Vendor

When to consider purchasing an evals tool and how to avoid premature adoption that wastes resources

Design Your AI Evals Playbook First—Then Select Tools

Understand how to use your internal evals playbook, team alignment, and clear metrics to drive tool selection

How to Assess Fit for Your Use Case

Gain tactics for matching tool capabilities to your project's needs, from pre-release evals to post-production analytics

Why this topic matters

Choosing an AI evals vendor? Vendors like Braintrust, Arize, and LangSmith promise powerful features, but flashy tools can distract from your needs. This talk cuts through the hype, helping you prioritize core functionalities like tracing, dataset generation, metrics, experiments, and monitoring. Learn to define your evals strategy and select a tool that delivers genuine product impact.

You'll learn from

Stella Liu

Head of Applied Scientist, AI Evals

Stella Liu is an AI Evaluation practitioner and researcher, specializing in frameworks for large language models and AI-powered products.

Since 2023, she has led real-world AI evaluation projects in EdTech, where she established the first AI product evaluation framework for Higher Education and continues to advance research on the safe and responsible use of AI. Her work combines academic rigor with hands-on product experience, bringing proven evaluation methods into both enterprise and educational contexts.

Earlier in her career, Stella worked at Shopify and Carvana, where she built large-scale data-driven automation systems that powered product innovation and operational efficiency at scale.

Stella also writes an AI Evals newsletter on Substack: https://datasciencexai.substack.com/

Follow Stella on LinkedIn

Amy Chen

Co-Founder at AI Evals & Analytics

Amy Chen is co-founder of AI Evals & Analytics and an AI partner helping companies with AI engineering, product development, and go-to-market strategy. With over 10 years of experience spanning data science, product management, ML engineering, and GTM, she brings versatile expertise to startups at every stage.

She is Top 1% Mentor in AI/ML Engineering and mentored over 300 data scientists and analysts on ADPList. She posts regularly about AI and data science on LinkedIn and has over 9.6k followers.

Follow Amy on LinkedIn

Previously at