4.7 (29)
6 Weeks
·Cohort-based Course
Follow a repeatable process to continually evaluate and improve your RAG application
This course is popular
14 people enrolled last week.
4.7 (29)
6 Weeks
·Cohort-based Course
Follow a repeatable process to continually evaluate and improve your RAG application
This course is popular
14 people enrolled last week.
Instructor Clients
Course overview
Become the RAG Product Leader Your Company Needs
Companies are racing to integrate AI features that truly deliver value. To stay ahead, you must master the art of building Retrieval-Augmented Generation (RAG) products that continuously improve—no luck or guesswork required.
6 Weeks to Transform Your AI Product Sense
This course removes the mystery and turns RAG from a risky experiment into a structured, data-driven practice. You’ll learn how to pinpoint what’s working, diagnose what’s not, and steadily raise the bar on performance and user satisfaction.
What You’ll Learn, Week-by-Week
Week 1: Fundamentals & Synthetic Data
Establish a repeatable system for evaluating and improving RAG
Generate synthetic datasets for fast, meaningful experiments
Master precision, recall, and essential retrieval metrics
Lay the groundwork for a self-reinforcing improvement cycle
Week 2: Segmentation & Analysis
Break down complex query patterns and user behaviors
Spot inventory gaps and capability shortfalls quickly
Use clustering, classification, and dashboards to track progress
Set improvement priorities that deliver maximum impact
Week 3: Structured Data & Multimodality
Extract and leverage metadata for more accurate retrieval
Handle images, documents, and tables without losing quality
Create specialized indexes and blend them effectively
Apply earlier techniques to broaden RAG capabilities
Week 4: Query Routing & Tool Selection
Integrate multiple search methods into a single coherent product
Route queries intelligently using parallel function calls
Turn tool selection into a quantifiable, improvable task
Secure higher success probabilities end-to-end
Week 5: Representations & Fine-Tuning
Move beyond generic embeddings into fine-tuned, domain-specific vectors
Develop re-rankers that drastically improve retrieval quality
Discover how small amounts of targeted data can yield big gains
Shorten the experimentation cycle for continuous improvement
Week 6: Product UX & Feedback Loops
Design user interfaces that collect feedback effortlessly
Use streaming and visual hints to make latency feel negligible
Implement citations, follow-up actions, and chain-of-thought prompting
Add validators and checks to ensure reliability at scale
Why This Matters
RAG has become a core differentiator for AI-driven products. The strategies you learn here will never go out of style. As tools and models evolve, you’ll know how to integrate them, measure their impact, and refine your approach—over and over.
What’s Included
Proven evaluation frameworks that demystify “is it working?”
Techniques to handle more data types, faster and more accurately
Methods for continuous feedback collection and refinement
Insights that adapt as the AI landscape changes
About Your Instructor
Jason Liu is a seasoned AI consultant who has guided ai engineering at Stitch Fix, and high-growth startups from Seed stage to public companies.
He also advises many of today's generative AI startups. Jason specializes in transforming vague AI ambitions into concrete, measurable practices that deliver real business value.
Exclusive Bonuses ($1,500+ Value)
$500 Cohere credits
$200 LanceDB credits + free Lance Cloud access
$500 Modal Labs credits
6 months of Notion AI Plus
3 months of Braintrust access ($250 value)
Who Should Apply
Product teams integrating AI features into real software products
AI engineers moving from prototype to production-grade performance
Anyone committed to developing true “AI product sense”—not just hype
You Only Pay After Acceptance & Full Refund Guarantee
We’re so confident in the course’s value that if you don’t see meaningful improvements in your product’s performance within five weeks of starting, we’ll refund you fully.
Don’t let uncertainty stall your AI progress.
Join a small cohort of dedicated practitioners, learn the proven frameworks, and build the RAG systems your users will love.
01
A product leader, engineer, or data scientist looking to move beyond ad-hoc RAG prototypes into scalable, production-grade AI solutions.
02
A professional who understands LLM basics but wants a repeatable, data-driven methodology to improve retrieval relevance, latency, and user
03
Eager to create feedback loops that continuously refine and enhance the quality of RAG applications as models, data, and user needs evolve.
Adopt a Systematic, Data-First Methodology
Implement the Data and Evals Flywheel approach to continuously develop and improve RAG applications—breaking free from guesswork and relying on measurable, iterative enhancements.
Run Fast, Unit-Test-Like Evaluations
Quickly assess your retrieval systems using precision and recall metrics, identify bottlenecks, and confidently validate changes without sinking into endless trial-and-error cycles.
Leverage Synthetic Data for Rapid Iteration
Generate and utilize synthetic data sets to speed up experimentation, enabling you to test new approaches, embeddings, and architectures before committing full resources.
Master Fine-Tuning & Hard Negative Mining
Apply fine-tuning strategies for embedding models to boost search relevance and explore hard negative examples to further sharpen retrieval performance.
Classify Queries & Identify Bottlenecks
Use query classification and segmentation techniques to pinpoint exactly where your RAG system falls short—whether it’s due to limited inventory or insufficient capabilities.
Design Specialized Indices for Multiple Modalities
Create tailored indices for documents, images, tables, SQL databases, and more. Learn when and how to fuse or layer these indices to handle complex retrieval tasks elegantly.
Enhance Retrieval with Summarization & Chunking
Implement synthetic text chunk generation and strategic summarization methods to improve retrieval results, ensuring end-users get clear, concise, and contextually rich answers.
Implement Query Routing & Index Fusion
Develop systems that intelligently route queries to the right indices, tools, or pipelines. Blend and fuse indices effectively to handle nuanced, multi-step queries.
Optimize Both Global & Local Performance
Evaluate the performance of your routing logic and each individual index separately. Gain the nuance to fine-tune global system performance and local retrieval accuracy in tandem.
Integrate Feedback Loops for Continuous Improvement
Design explicit and implicit feedback mechanisms—capturing user signals, automating re-labeling, and applying improvements in real-time to keep your RAG systems on an upward trajectory.
25 interactive live sessions
Lifetime access to course materials
54 in-depth lessons
Direct access to instructor
Projects to apply learnings
Guided feedback & reflection
Private community of peers
Course certificate upon completion
Maven Satisfaction Guarantee
This course is backed by Maven’s guarantee. You can receive a full refund within 14 days after the course ends, provided you meet the completion criteria in our refund policy.
Systematically Improving RAG Applications
Feb
4
Office Hour
Feb
4
Office Hour
Feb
5
Building scalable RAG applications: Evolving workflows for sharing and optimization [Ankur Goyal]
Feb
6
Office Hour
Feb
11
Office Hour
Feb
11
Office Hour
Feb
12
Building Houses, Digging Holes, and Searching for Gold [Mukul Surajiwale]
Feb
13
Office Hour
Feb
18
Office Hour
Feb
18
Office Hour
Feb
19
Building Document Workflow Agents [Jerry Liu]
Feb
20
Office Hour
Feb
25
Office Hour
Feb
25
Office Hour
Feb
26
Organizing Your Data for Query Routing [Anton Troynikov]
Feb
27
Office Hour
Mar
4
Office Hour
Mar
4
Office Hour
Mar
5
Guest Speaker
Mar
6
Office Hour
Mar
11
Office Hour
Mar
11
Office Hour
Mar
12
Vantager: RAG for Financial Reports [Nicolas Neven]
Mar
13
Office Hour
Mar
19
4.7 (29 ratings)
Jason has built search and recommendation systems for the past 6 years. He has consulted and advised a dozens startups in the last year to improve their RAG systems. He is the creator of the Instructor Python library.
Join an upcoming cohort
Cohort 2
$1,650
Dates
Application Deadline
Tuesday: Workshops
1:00 - 2:00PM ET
Workshops covering each step of the playbook and helping you build process improvements in your RAG application
Wednesday: Office Hours + Breakout Sessions
1:00 - 2:00PM ET
The first half hour will be interactive breakout sessions, and the closing half-hour each week is Q&A
Thursday: Guest Speakers
1:00 - 2:00PM ET
Guest instructors covering key topics in both innovative theory and practical applications in RAG system development.
Active hands-on learning
This course builds on live workshops and hands-on projects
Interactive and project-based
You’ll be interacting with other learners through breakout rooms and project teams
Learn with a cohort of peers
Join a community of like-minded people who want to learn and grow alongside you
Sign up to be the first to know about course updates.
Join an upcoming cohort
Cohort 2
$1,650
Dates
Application Deadline