LLM-as-Judge: Score Your AI Automatically

Part of The AI Evaluation Handbook

Hosted by Aki Wijesundara and Manu Jayawardana

Wed, Jul 22, 2026

3:00 PM UTC (30 minutes)

Virtual (Zoom)

Free to join

Invite your network

Go deeper with a course

AI Engineering Bootcamp & Certificate
Aki Wijesundara, PhD and Manu Jayawardana
View syllabus

What you'll learn

Why manual review does not scale

See how fast hand grading falls apart once you have more than a handful of outputs to check.

Write a judge prompt with a rubric

Give the judge clear criteria and a scoring scale so its grades stay consistent and explainable.

Score a whole batch at once

Run the judge across many outputs and get back numbers and reasons you can sort and filter.

Why this topic matters

Reading hundreds of AI outputs by hand to check quality does not scale. The trick is to use a second model as a judge that scores the first one for you. In this free 30 minute session you write a judge prompt with a clear rubric, run it across a batch of outputs, and watch it return scores and reasons you can trust enough to act on. You leave able to set up an LLM judge that grades your AI's output automatically.

You'll learn from

Aki Wijesundara

AI Advisor | Educator | Google AI Accelerator Alum

Aki Wijesundara is an AI leader with a PhD in Machine Learning and extensive experience mentoring startups at Google’s AI Accelerator. With a career spanning both research and applied AI, Aki has taught 5,000+ students worldwide how to design and deploy production-ready AI systems.

He has worked across cutting-edge areas of applied AI, from LangChain and RAG pipelines to observability and large-scale deployment. As a researcher and educator, Aki bridges the gap between theory and practice, making complex systems approachable and actionable for engineers, founders, and product leaders.

Aki is also a frequent speaker and advisor to organizations adopting AI, helping them transition from experimentation to production at scale.

Manu Jayawardana

AI Founder | Co-Founder & CEO at Krybe | Co-Founder of Snapdrum

Manu Jayawardana is a serial entrepreneur with multiple AI startup successes.

He is also the Co-Founder of Snapdrum, an AI consultancy helping companies integrate and automate their businesses using AI. Through Snapdrum, Manu has worked with top startups and enterprises across the U.S., Europe, and Asia, advising on automation, product development, and AI strategy.

Currently, Manu is the Co-Founder & CEO of Krybe, an AI voice agent startup in London transforming how businesses automate customer interactions. His experience spans fundraising, scaling products, and leading teams to deliver production-grade AI solutions adopted globally.

See all products from TAI

Sign up to join this lesson

By continuing, you agree to Maven's Terms and Privacy Policy.