Evaluating Agents is a Continuous, Iterative Journey

Hosted by Harrison Chase and Hamel Husain

Thu, Jul 3, 2025

6:30 PM UTC (30 minutes)

Virtual (Zoom)

Free to join

Invite your network

Go deeper with a course

AI Evals For Engineers & PMs
Hamel Husain and Shreya Shankar
View syllabus

What you'll learn

Strategies for measuring dynamic systems

Agents don't have a fixed behavior. We'll show you analytical tools you can use to tame them.

Evaluation Metrics For Agents

Principles and guidance for defining metrics for evaluating agents.

How to use evals to iterate & improve upon agents

Leverage evals to drive real improvements in your system.

Why this topic matters

This matters because it reflects a fundamental shift in how we build and maintain AI systems—especially autonomous or semi-autonomous agents like AI copilots, task bots, or decision-making systems. 1. Agents Don’t Have a Fixed Behavior 2. Agents Interact With the Real World 3. Evaluation Metrics Are Complex 4. Iterative Improvements Drive Performance 5. 5. Helps Build Trust and Reliability

You'll learn from

Harrison Chase

Co-Founder and CEO at LangChain

Harrison is the co-founder and CEO of LangChain, an open-source framework designed to help developers build applications powered by large language models (LLMs). With a background in machine learning and deep learning systems, Harrison previously worked at Robust Intelligence and Google. He launched LangChain in 2022 to simplify the creation of intelligent agents and context-aware applications, rapidly becoming a leading figure in the emerging AI tooling ecosystem. His work focuses on enabling more powerful, composable, and production-ready LLM applications.

Hamel Husain

ML Engineer with 20 years of experience

Hamel is a machine learning engineer with over 20 years of experience. He has worked with innovative companies such as Airbnb and GitHub, which included early LLM research used by OpenAI, for code understanding. He has also led and contributed to numerous popular open-source machine-learning tools. Hamel is currently an independent consultant helping companies build AI products.

Learn directly from Harrison Chase and Hamel Husain

By continuing, you agree to Maven's Terms and Privacy Policy.

© 2025 Maven Learning, Inc.