LLM-as-Judge: Grade Your AI Feature's Quality

Part of The AI Evaluation Handbook

Hosted by Aki Wijesundara and Manu Jayawardana

Tue, Jul 7, 2026

3:00 PM UTC (30 minutes)

Virtual (Zoom)

Free to join

Invite your network

Go deeper with a course

AI Engineering Bootcamp & Certificate
Aki Wijesundara, PhD and Manu Jayawardana
View syllabus

What you'll learn

What LLM-as-Judge actually means

Using AI to grade AI in plain words, so you can measure quality at a scale reading cannot.

Set a standard for it to grade against

Define what good looks like so the judge scores answers the way you would.

Know where the judge is reliable

The cases where automated grading is trustworthy and the ones where you still look yourself.

Why this topic matters

Checking AI answers by reading them one by one does not scale past the first ten. This free 30 minute session shows LLM-as-Judge in plain terms: using one AI to grade another AI's answers against a standard you set, so quality gets measured instead of eyeballed. We take real outputs from a feature and set up a judge to score them live, and talk through where it is trustworthy and where it is not. You leave able to grade your AI feature's quality at scale instead of spot checking and hoping.

You'll learn from

Aki Wijesundara

AI Advisor | Educator | Google AI Accelerator Alum

Aki Wijesundara is an AI leader with a PhD in Machine Learning and extensive experience mentoring startups at Google’s AI Accelerator. With a career spanning both research and applied AI, Aki has taught 5,000+ students worldwide how to design and deploy production-ready AI systems.

He has worked across cutting-edge areas of applied AI, from LangChain and RAG pipelines to observability and large-scale deployment. As a researcher and educator, Aki bridges the gap between theory and practice, making complex systems approachable and actionable for engineers, founders, and product leaders.

Aki is also a frequent speaker and advisor to organizations adopting AI, helping them transition from experimentation to production at scale.

Manu Jayawardana

AI Founder | Co-Founder & CEO at Krybe | Co-Founder of Snapdrum

Manu Jayawardana is a serial entrepreneur with multiple AI startup successes.

He is also the Co-Founder of Snapdrum, an AI consultancy helping companies integrate and automate their businesses using AI. Through Snapdrum, Manu has worked with top startups and enterprises across the U.S., Europe, and Asia, advising on automation, product development, and AI strategy.

Currently, Manu is the Co-Founder & CEO of Krybe, an AI voice agent startup in London transforming how businesses automate customer interactions. His experience spans fundraising, scaling products, and leading teams to deliver production-grade AI solutions adopted globally.

See all products from TAI

Sign up to join this lesson

By continuing, you agree to Maven's Terms and Privacy Policy.