Stella Liu
Free Lesson

Start AI Evals With Datadog, Splunk, New Relic

30 min
Sep 18, 2026 3:00 PM

By continuing, you agree to Maven's Terms and Privacy Policy.

What you'll learn

Use current observability tools for AI evals

See how platforms such as Datadog, Splunk, and New Relic can already support your AI evals needs

Turn observability data into evaluation signals

Learn which telemetry to capture and use to evaluate real-world AI agent interactions.

Build evaluation strategy on top of observability

Observability tools make evaluation easier, but success starts with knowing what to measure.

See Datadog LLM Observability in action

Watch a live Datadog walkthrough of tracing an AI agent, inspecting LLM and tool calls, and reading evals results

Why this topic matters

You may already have what you need to start evaluating AI systems. Tools like Datadog, Splunk, and New Relic can capture the traces, logs, and telemetry behind agent behavior. Join this session to see how that familiar observability can support AI evals, and why defining success, failure modes, and meaningful metrics matters more than finding the “perfect” platform.

You'll learn from

Stella Liu

Stella Liu

Head of Applied Scientist, AI Evals

Previously at
Shopify.com
Carvana
Harvard University
UT Austin
See all products from AI Evals and Analytics
Get free access