Free Lesson
Build Your First Simulation Environment for Evals & RL
60 min
Oct 16, 2026 12:00 PM
By continuing, you agree to Maven's Terms and Privacy Policy.
What you'll learn
Understand What an AI Simulation Environment Is
See how tasks, tools, state, and scoring become a reusable world for evals and reinforcement learning.
See How Eric Approaches Agent Evals
Learn how Eric’s AI evals experience shapes tasks, traces, and graders that expose where agents fail.
Build a Simulation Environment Live
Turn a real task into tools, test cases, and a grader you can reuse for evals or RL.
Why this topic matters
Better models alone don’t produce reliable agents—the environment determines what you can observe, evaluate, train, and trust. Aman and Eric will explain what simulation environments are, why teams use them for evals and RL, and how to design tasks, tools, state, and grading. Drawing on Eric’s experience leading product at an AI evals company, they’ll turn a real task into a repeatable environment live.
You'll learn from
Aman Khan
AI Product leader at Arize AI, Spotify, Cruise, Zipline, and Apple
Eric Xiao
Founder @ Bloom, prev. AI PM at Meta, Arize
