Cohort 3

Build and Optimize Production-Grade RAG and LLM Applications: Master Advanced Techniques for Scalable, Secure, and Low-Latency AI Solutions

Hamza Farooq

Enterprise RAG and Multi-Agent Applications

Google

Ucla

University of Minnesota

Welcome to today's most technically rigorous and hands-on Large Language Model (LLM) application course. This course is unique because each class is taught online and held with separate office hours - in total, we will conduct 15 sessions. Most courses are taught asynchronously, i.e., recorded sessions with Q&amp;A. We believe you should get what you pay for. There are 7 - 2 hr sessions for teaching and 7 office hours—1 session for DEMO DAY. We have increased our cohort to 10 weeks to allow you to learn and implement your projects thoroughly. This isn't just another AI course – it's your gateway to mastering the art and science of deploying production-grade LLM solutions that stand out in the real world. As part of Maven's Top-Rated Content, this course is designed for those who have already mastered the basics of RAG, cosine similarity, vector databases, and LLMs. We'll take you to the next level, focusing on practical aspects of packaging and deploying these models in real-world production environments. For cohort members joining this intensive learning experience, here's what you get: - 10 weeks of in-depth content in-person courses - We will teach you each class- Weekly office hours for personalized guidance- Real-world projects and challenging assignments- Guest Lectures by Leading AI Professionals- Continued support post-graduation- Lifetime access to course materials What You'll Master: Course Highlights Agents: Forget CrewAI or Autogen, build your won Agents from scratch. Learn what it takes to make an Agent from the ground. Contribute to Open Source community. Advanced RAG Solutions: Dive into enterprise-level RAG architectures and learn how to build and implement semantic caching from scratch using GCP and Redis. LLM Hosting and Deployment: Gain insights into best practices for hosting Large Language Models (LLMs) in diverse production settings, creating inference endpoints, and deploying LLMs on serverless platforms. Continual Pre-Training and Fine-Tuning: Explore advanced techniques for continual pre-training, fine-tuning LLMs, and mitigating catastrophic forgetting. Learn how to build a data pipeline for pre-training, apply causal language modeling, and leverage scaling laws. Model Merging and Mixture of Experts: Master techniques for merging multiple models to enhance their collective capabilities, including the Mixture of Experts (MoE) approach. Learn to use tools like mergekit for efficient model merging. Quantization Methods: Discover techniques to reduce model size while maintaining performance, crucial for deployment in resource-constrained environments. Inference Speed Optimization: Learn strategies to accelerate inference speeds for real-time language processing, ensuring efficient and responsive AI systems. Responsible AI Implementation: Explore ethical AI development using guardrails like NeMo, Colang, and Llama Guard to ensure AI systems align with responsible AI principles. Agentic RAG and Chunking Strategies: Implement advanced semantic chunking techniques and explore AI agent frameworks like AutoGen to enhance the capabilities of RAG systems. DSPy and Knowledge Graphs: Learn to create and utilize knowledge graphs effectively, mastering DSPy as an alternative prompting approach for structured data handling and enhanced AI interaction. Throughout the course, we will analyze state-of-the-art AI products, reverse-engineering some through Python. As a bonus, you'll have access to experimental products being developed at Traversaal.ai, my startup, allowing you to stay at the forefront of advancements in the field. Prerequisite: You should have coding experience of building RAG Solution. Understanding of Encoders and Decoders and some knowledge of Cloud Solutions and APIs. If you feel the need for a more foundational course, consider checking out my other offering on LLMs: Building LLM Applications (https://maven.com/boring-bot/ml-system-design).

The LLM Technical Course: Build and Deploy Production-Grade Gen AI Products

Machine Learning Engineer exploring different techniques to scale LLM solutions

Researcher, who would like to delve in to various aspects of open-source LLMs

Software Engineer, looking to learn how to integrate AI into their products

This course is for you if you are a:

What you’ll get out of this course

Understand and implement complex AI architectures, including enterprise-level RAG systems and agentic RAG strategies. You will also dive deep into the Mixture of Experts (MoE) technique and other model merging strategies to enhance the capabilities of your AI systems.

Advanced AI Architectures

From building semantic caches using GCP and Redis to deploying LLMs on serverless platforms like AWS Bedrock, you'll learn the practical skills to deploy and manage AI applications in real-world scenarios.&nbsp;

Practical Skills for Deployment

Acquire advanced techniques for fine-tuning LLMs, enabling you to adapt these models to specific tasks or domains and enhance their performance in targeted applications.

Fine-Tuning Expertise

Explore strategies for exploring and optimizing inference speeds, ensuring that your language models perform efficiently in real-time scenarios, a crucial skill for deploying responsive and scalable applications.

Efficient Inference Processing

Understand the importance of ethical AI development and learn to implement guardrails using tools like NeMo, Colang, and Llama Guard to ensure your AI systems align with responsible AI principles.

Knowledge of Responsible AI

Provide a brief description for each module as a way to sell the value of what students will be learning throughout the course.

First Module

Second Module

Third Module

Course syllabus

What people are saying

Meet your instructor

Sundays

Work in teams to build solutions, this requires engagement with other team members

Weekly projects

Course schedule

This course builds on live workshops and hands-on projects

Active hands-on learning

You’ll be interacting with other learners through breakout rooms and project teams

Interactive and project-based

Join a community of like-minded people who want to learn and grow alongside you

Course completed by

About this course

Get notified about the next cohort

Learn from live sessions