Let's Code an LLM App from Scratch

New
·

3 Weeks

·

Cohort-based Course

Build robust LLM-powered apps, chatbots, and agents. Learn by writing real code, one line at a time.

Course overview

Gain hands-on AI Engineering proficiency by writing real code

Do you have a grasp of basic LLM principles but struggle to put it all into code? Tired of scattered documentation, outdated tutorials, and frameworks that impress in demos but collapse in production?


You’re not alone. Building with large language models doesn’t have to be confusing - it can be clear, structured, and deeply rewarding.


In this course, you’ll build real LLM-powered apps, one line of code at a time. You'll see how an app is built from scratch in real time, and follow along. Along the way, you'll discover not only how to implement these systems, but the why behind each line of code.


From chatbots to agents and RAG to evals, you’ll learn the core concepts of building atop LLMs. More importantly, you’ll get how LLMs “think” - allowing you to guide them to do what you want despite their nondeterministic nature. Additionally, you’ll be able to balance quality, latency, and cost, making big-picture decisions about AI-powered app architecture. 


AI engineering isn’t just another branch of software development - it’s a different mindset altogether.


Unlike most areas of software engineering, which extend well-understood coding principles, AI engineering breaks the mold. It demands an entirely new way of thinking - one that challenges traditional logic and redefines how you approach building with code.


You’ll discover how to:


⚡︎ Engineer context and retrieval systems so your AI can understand and use your proprietary data.


⚡︎ Build custom chatbots that answer organization-specific questions and help users solve real problems.


⚡︎ Design intelligent agents that research, reason, and take action autonomously.


⚡︎ Level up your prompt engineering so the model follows your intent - not its own.


⚡︎ Use evaluations to continuously monitor LLM output quality.


⚡︎ Embrace the AI-engineering mindset to harness LLM power to achieve your goals no matter the application.


By the end, you’ll have a repeatable, end-to-end framework for creating AI applications that are stable, adaptable, and grounded in real-world principles - not hype. When the next trend hits, you’ll have the foundation to evolve with it, not chase it.



~~~~~~~~~~~~~~~~~~

COURSE DETAILS

~~~~~~~~~~~~~~~~~~


This course is taught live over Zoom by Jay Wengrow, author of A Common-Sense Guide to AI Engineering. You'll receive a free ebook copy, as this course and the book complement each other for a complete learning experience. However, reading the book is not strictly required for the course.


Rather than merely being lectured to about theoretical concepts, you'll watch and follow along as Jay builds LLM-powered apps from the ground up, one line of code at a time. Along the way, he'll show you not just what to do, but explain why we're doing it, building up deep understanding and intuition of how LLMs behave so you can tame them no matter what you're building.


The live classes will be recorded, so you can watch/rewatch them at any point. You'll have access to these videos on the Maven platform forever.


In addition to the live lectures, you'll receive three optional weekend projects so you can put your newfound skills into practice. Hands-on work is key for mastering the skills taught in this course. You'll also use real-time messaging to communicate with Jay and cohort peers.



~~~~~~~~~~~~~~~~~~

COURSE OUTLINE

~~~~~~~~~~~~~~~~~~


Session #1: Getting Started with LLMs

▻ Understanding how LLMs work

▻ Wrangling with the challenges of nondeterminism

▻ Selecting an LLM and augmenting prompts


Session #2: Building a Chatbot

▻ Multi-turn dialogue and conversation history

▻ Adding the system prompt

▻ Augmenting an LLM with knowledge

▻ Working with long context and its associated challenges


Session #3: RAG

▻ Working with semantic-search engines

▻ Preparing a search engine with data prep and ingestion

▻ Measuring recall and precision

▻ Integrating semantic search into the chatbot


Session #4: Evals

▻ Open coding

▻ Axial coding

▻ Creating an eval framework

▻ Running evals


Session #5: Prompt and Context Engineering

▻ Specificity and few-shot prompting

▻ Sequencing and delimiter usage

▻ Techniques for reducing hallucinations


Session #6: Agentic Systems

▻ Tool use/function calling

▻ Running an agent loop

▻ Reducing nondeterminism with agentic workflows

▻ Agentic RAG 

Who is this course for

01

Software engineers who want to build LLM-powered chatbots and agents, or break into AI engineering more generally

02

Data Scientists/Engineers who want to build their own LLM-powered apps

03

Product Managers who want to understand AI engineering from the coding perspective

Prerequisites

  • Software Engineering

    This course is designed for current software engineers who will use Python to build LLM-powered apps. We won't teach basic coding here.

  • Note about Python

    We'll be using Python, but we'll keep it simple in case you're more familiar with other coding languages.

  • Exception: Product Managers

    If you want an inside look at what's involved with building AI apps but don't plan on coding yourself, you'll still follow what's going on.

What you’ll get out of this course

Gain real-world intuition for working with LLMs so you can navigate shifting tools without falling for the hype cycle.

You'll create LLM-powered apps from scratch without needing to rely on frameworks that abstract away the important details.

Engineer robust prompts and context pipelines so you can reliably guide LLMs instead of getting unpredictable results.

LLMs are unpredictable by nature, but you'll know how to steer them into doing what you want and achieving your goals.

Build retrieval-augmented assistants that can access proprietary knowledge and answer user-specific questions.

You'll build chatbots that converse accurately about your organization's data and help advise users appropriately.

Use evals to iterate and optimize so you can systematically improve your app’s performance over time.

Instead of simply hoping that your newest updates make things better and not worse, you'll use evals to consistently measure and upgrade your app's performance.

Assemble agents that act upon the real world.

You'll equip LLMs with tools that can do more than generate text - they'll trigger real code functions that can send emails, call web APIs, and more.

What’s included

Jay Wengrow

Live sessions

Learn directly from Jay Wengrow in a real-time, interactive format.

Hands-on projects

Optional projects will give you the opportunity to put your newfound skills into practice

Lifetime access

Go back to course content and recordings whenever you need to.

Community of peers

Stay accountable and share insights with like-minded professionals.

Certificate of completion

Share your new skills with your employer or on LinkedIn.

Free book: A Common-Sense Guide to AI Engineering

You'll get Jay's eBook which complements the course and extends the material even further.

Maven Guarantee

This course is backed by the Maven Guarantee. Students are eligible for a full refund up until the halfway point of the course.

Course syllabus

Week 1

Jan 6—Jan 11

    Lesson #1: Getting Started with LLMs

    • Jan

      6

      Workshop #1: Getting Started with LLMs

      Tue 1/67:00 PM—9:00 PM (UTC)

    Lesson #2: Building a Chatbot

    • Jan

      8

      Workshop #2: Building a Chatbot

      Thu 1/87:00 PM—9:00 PM (UTC)

Week 2

Jan 12—Jan 18

    Lesson #3: Making Your Bot Smarter with RAG

    • Jan

      13

      Workshop #3: Making Your Bot Smarter with RAG

      Tue 1/137:00 PM—9:00 PM (UTC)

    Lesson #4: Maintaining Quality with Evals

    • Jan

      15

      Workshop #4: Maintaining Quality with Evals

      Thu 1/157:00 PM—9:00 PM (UTC)

Week 3

Jan 19—Jan 22

    Workshop #5: Prompt and Context Engineering

    • Jan

      20

      Workshop #5: Prompt and Context Engineering

      Tue 1/207:00 PM—9:00 PM (UTC)

    Workshop #6: Building Agentic Systems

    • Jan

      22

      Workshop #6: Building Agentic Systems

      Thu 1/227:00 PM—9:00 PM (UTC)

Praise for Jay's book: A Common-Sense Guide to AI Engineering

        This is the guide I wish I had when I started building with LLMs. It masterfully bridges the gap between theory and practical realities of shipping AI products, teaching the crucial, hard-won lessons about iteration and trade-offs that define professional AI engineering.
Nithin Singh Mohan

Nithin Singh Mohan

AI & Supercomputing Leader, Hewlett Packard Enterprise
        Jay Wengrow has a knack for explaining complex ideas in a simple and intuitive way. His latest book will help anyone understand the ins and outs of AI engineering. I highly recommend it to anyone looking to get into this field.
Monsur Khan

Monsur Khan

Senior Associate Data Engineer, Infosys
        Jay Wengrow demystifies AI engineering, transforming complex topics like RAG, evals, and agents into practical actionable steps. This book is an essential guide for any developer looking to build robust, real-world LLM applications.
Iyanuoluwa Ajao

Iyanuoluwa Ajao

AI Engineer
        The book strikes the perfect balance between clarity and depth. Jay Wengrow explains complex LLM concepts with humor, precision, and hands-on examples that make the book as enjoyable as it is indispensable.
Michael Geng

Michael Geng

Computer Vision and Machine Learning Engineer, Lumachain

Meet your instructor

Jay Wengrow

Jay Wengrow

Software Engineer, Educator, Author

Jay Wengrow is an experienced educator and software engineer, and the author of A Common-Sense Guide to AI Engineering. He is also the founder of Actualize, a software and AI engineering education company, and specializes in making advanced technical topics approachable for professionals across industries. He also wrote the popular Common-Sense Guide to Data Structures and Algorithms book series.

A pattern of wavy dots

Join an upcoming cohort

Let's Code an LLM App from Scratch

Cohort 1

$1,000

Dates

Jan 6—22, 2026

Payment Deadline

Jan 6, 2026
Get reimbursed
Free resource

Understand LLM Tools

Download this free excerpt from Jay's book A Common-Sense Guide to AI Engineering. In it, you'll learn how an LLM uses tools under the hood. This knowledge is the foundation for building agents that do what you want.

Get this free resource

Learning is better with cohorts

Learning is better with cohorts

Active hands-on learning

This course builds on live workshops and hands-on projects

Interactive and project-based

You’ll be interacting with other learners through breakout rooms and project teams

Learn with a cohort of peers

Join a community of like-minded people who want to learn and grow alongside you

Frequently Asked Questions

Stay in the loop

Sign up to be the first to know about course updates.

A pattern of wavy dots

Join an upcoming cohort

Let's Code an LLM App from Scratch

Cohort 1

$1,000

Dates

Jan 6—22, 2026

Payment Deadline

Jan 6, 2026
Get reimbursed

$1,000

USD

3 Weeks