AI Analyst Lab

Cohort 1

Cohort 3

Cohort 2

Bootcamp 2

Bootcamp 4

Bootcamp 1

Bootcamp 5

Bootcamp 3

Asycn 1

36 free lessons on evaluating, measuring, and improving AI-powered products. Full slide decks with written explanations. Weekly quizzes and a certification exam. What you'll learn<ul><li>Design observable AI systems with proper logging and trace architecture</li><li>Run structured failure analysis on production data</li><li>Translate AI quality metrics to user behavior and business results</li><li>Build evaluation workflows from offline tests through production monitoring</li><li>Make ship/iterate/pause/rollback decisions based on evaluation data</li></ul>

Free 6-week AI Evals Certification Course

Product managers who drive strategy, development, and launch of products.

Engineers and engineering leaders who build, deploy, and scale software systems.

Data scientists who apply statistical and ML techniques to extract insights from data.

Applying AI tools and techniques to professional workflows — assign alongside more specific AI topics.

Building autonomous AI agent systems that take actions, use tools, and orchestrate multi-step workflows.

Using data and metrics to measure performance, run experiments, and inform decisions.

Using Claude Code to build and ship software through an AI-powered command-line coding workflow.

Leave with a working agentic analytics system on your machine, a polished analysis, and the patterns and frameworks to make it all yours.

Principal Data Scientist @ Ontra 

Shane Butler

Principal Data Scientist @ Ontra | Ex-Stripe, Nextdoor, PwC, Appfolio

Data Science Leader |Ex-Microsoft

Sravya Madipalli

Data Science Leader@Superhuman (Prev. Grammarly)| Ex-Microsoft, eBay, Nextdoor

Head of Data @ Ontra AI | Ex-LinkedIn

Hai Guan

Head of Data @ Ontra | Ex-Nextdoor, LinkedIn, Pinterest, Meta

Build Agentic Analytics 101 in Claude Code

Senior Manager, Data Analytics

AI & Data Partner, Operations

Senior UX Designer

VP of Analytics

Set Up Claude Code for Analytics for the First Time

Principal Data Scientist @ Ontra

Principal Data Scientist @ Ontra | Ex-Stripe, Nextdoor, PwC

Data Science Leader | Ex-Microsoft

Intro to Agentic Analytics in Claude Code

Master Student

Data Scientist

This is a hands-on weekend bootcamp (4 hours Saturday, 4 hours Sunday) where you build AI analysts powered by Claude Code. Not a lecture series. Not a demo you watch. You set up your own environment, build custom skills and agents, connect to real data, and leave with a working system that turns business questions into charts, narratives, and presentations in minutes.No Python. No SQL. No coding of any kind. Claude Code writes all the code. You direct the analysis.By Sunday evening, you will have a complete AI analyst repo on your computer: 45 skills, 27 agents, data connections, and a finished analysis you can share with your manager Monday morning. Everything runs locally. No vendor lock-in. No proprietary platform. Just a repo you own.AI is changing how teams make decisions with data. The bottleneck is no longer the analysis — it is knowing how to set up the tools. This bootcamp gives you that setup in a weekend. You will not learn about agentic systems. You will build one.

Build agentic data analysts for your company in one weekend. No code.

Set up Claude Code as your personal AI Analyst environment

Build custom skills that encode your analytical thinking

Build and chain agents into a multi-agent analytics system

Read and integrate your work into a production AI Analyst

Expand the system, then connect it to your team's tools

Product managers who are tired of waiting in the data team's queue. Stop waiting. Analyze it yourself.

Data scientists who want to multiply their output. You know how to do the analysis manually. Now automate it.

Engineers who want to make data-driven decisions without hiring a data team.

Transform from consumer of analytics to independent operator - asking sharp questions, validating answers, shipping decisions.

Stripe

Nextdoor

PwC India

Ontra

AppFolio

Microsoft

eBay

Grammarly

Superhuman

LinkedIn

Pinterest

Ask Better Questions, Make Faster Decisions - with AI as Your Analyst

Frame Problems Like a Senior Data Scientist

Design Metrics That Actually Drive Decisions

Diagnose Root Causes Without Guessing

Design Experiments That Ship

Turn Analysis Into Action With AI as Your Copilot

Synthesize Insights and Prioritize for Impact

Product Managers, engineers, and operators who need analytical independence and frameworks to measure success and drive decisions.

Designers and researchers stepping into strategy roles who need to quantify impact, run experiments, and influence with data-driven insights

Data professionals who want to frame better questions, delegate technical execution to AI, and drive impact with agentic analytics tools.

You already build agentic analyses for yourself. Learn to make them reliable enough to stand behind in front of a team — across models, with

Co-founder @ AI Analyst Lab

PwC España

You've built an agentic analytics system that works for you. You run Claude Code in the terminal, write skills, chain agents, and ship an analysis end to end. This course is the next step: making that system reliable enough to trust at team scale.Solo, you can eyeball whether an answer looks right. Across a team, you can't. Two people run the same query and get different numbers. The model your workflow depends on gets deprecated overnight. An AI-written analysis reads beautifully and is quietly wrong. This course engineers past all three.You'll swap the brain of Claude Code between frontier and open-source models, so you're never locked in or cut off. You'll build a multi-model validation loop where one model builds, another reviews, and you judge the disagreement, plus the four eval types that catch what a single pass misses. And you'll engineer the context and semantic layers that makes any model produce consistent, audience-ready work.You leave with a complete agentic analytics system you built yourself, one repo that runs on both Claude Code and Codex, and reference guides you'll keep using.For people who already work agentically and want to do it reliably, at team scale.

Proven playbook to make your AI data analyst reliable enough to trust at team

Swap the brain of Claude Code between any model

Validate AI data analysis with confidence

Engineer context so any model stays consistent

Codex and open-source model compatible agentic analytics system

Product managers already using Claude Code for analysis. You've built skills and agents. Now build a system that validates its own output.

Data scientists who know how to work with Claude Code. Now automate the full workflow: context loading, analysis, validation, and narrative.

Analysts and engineers comfortable with skills and agents who want to go deeper in Claude Code.

Learn practical, hands-on methods to evaluate, measure, and improve AI products using data science to make better product decisions.

Principal Data Scientist, AI Evaluations

Principal Data Scientist, AI Evaluations at Ontra

With the recent leaps in model capabilities, it is becoming clear that much of the AI evaluation work previously requiring humans to build and run can be automated through agentic systems. This course teaches you how to build those systems, and where human judgment and input is still required.The foundational work of designing eval frameworks, defining quality signals, and structuring failure analysis remains critical. But the execution of that work, running evaluations, scoring results, iterating on improvements, and surfacing what matters, can now be handled by agentic workflows that operate continuously and at scale.This course equips you with the capability to build, test, and deploy automated evaluation systems using Claude Code. You will leave with working systems, not just conceptual understanding.The focus is on automation that is trustworthy. Systems that score their own output, flag uncertainty, and know when to surface decisions to a human rather than proceeding autonomously.The foundational content on AI evals for product development is available free at <a target="_blank" rel="noopener noreferrer nofollow" href="https://aianalystlab.ai">aianalystlab.ai</a>. If you are new to AI evals, start there.

Build the agentic systems that automate your AI evaluation workflow from end to 

Build agentic evaluation workflows in Claude Code

Automate scoring and quality assessment

Implement iterative improvement loops

Scale experiment execution

Integrate with production data and decision-making

You will get the most out of it if you are actively working on, or about to ship, AI features in a real product.

Real-World AI Product Experience

Product Managers: Want automated eval systems for your team? Learn what is possible, reliable, and where human oversight stays essential.<pre><code class="language-markdown"></code></pre>

Data Scientists &amp; Analysts: Spending more time running evals than learning? Build systems that handle execution so you focus on decisions.

Engineers and ML Engineers: val bottlenecks slowing your release cycle? Automate repetitive work and ship with speed and confidence.

Claude Code 101: Learn what Skills, Agents, and Hooks are

Analyze Data in Google Sheets with Claude Code

Pressure-test any AI analysis

AI Evals for Claude Code Analytics Output

Develop North Star Metrics with AI

Publish Analysis Everywhere with Claude Code

What's inside

Free recordings of every Agentic Analytics workshop. Run real product analysis with Claude Code. No SQL or Python.

 AI analytics workshops for Everyone!

Free AI Analytics Workshop Library

What it does

What you need

Where it comes from

Open-source agent that audits your North Star metric, decomposes what drove it, and builds the input tree. 

 Teaching builders to do real product analysis with AI. No SQL, no Python.

Free North Star Metric Agent for Claude Code

The course fee for this workshop is $50. Use PROMO code: LEARN50. Please read below to make sure this workshop is a good fit.***Who this workshop is NOT for- You've already installed Claude Code and are comfortable working with it in terminal.- You've already worked with the AI Analyst system and are familiar with how it runs.- You've built your own skills and agents in Claude Code terminal before.If any of those describe you, then you may want to check out our <a target="_blank" rel="noopener noreferrer nofollow" href="https://maven.com/dataneighbor/build-ai-analysts-in-claude-code">Claude Code Analytics Bootcamp</a>.***You've seen what Claude Code can do. But getting it running on your machine, pointed at real data, producing a real chart? Well that gap between "cool demo" and "it's running for me" can feel enormous.This workshop closes that gap in one hands-on morning.You walk in with zero Claude Code experience. You install Claude Code on your machine, clone the AI Analyst repo, point it at a dataset, and ship a real analysis.This is also where you start building community. A room of people who keep building together after Saturday, share what's working, learn from each other.No prior experience required! No coding required!Just a willingness to learn, try something new, and meet some new people :)

Watch a full analysis output done by AI, set up Claude Code, clone the AI Analyst repo, point at a real dataset, run your own analysis.

Set up your Claude Code environment for AI Analytics

Product managers tired of waiting in the data team's queue. Stop waiting. Build an AI analyst that does the analysis for you.

Data Analyst and Scientists who want to automate repetitive analysis. You know what good analysis looks like. Now build agents that execute.

Engineers who want data-driven decisions without a data team. Build the system yourself in one morning. No statistics degree required.

Learn directly from AI Analyst Lab

AI Analyst Lab

Courses

Build Agentic Analytics 101 in Claude Code

AI Analytics for Everyone

Agentic Analytics 201: Validation & Context Management

Automate AI Evals with Claude Code

Workshops