Cohort 1

Learn about core technologies and best practices for realtime, conversational AI. Explore models and tools with hands-on help from experts.

Kwindla Hultman Kramer

swyx

Voice Agents:  tech sessions and community events, 10k dollars in free credits

📢 🛜 🎉 $10,000 in credits from partner companies for all students in the class 🎉 🛜 📢 ➡️ $500 from Modal (https://modal.com/)➡️ $500 from Tavus (https://tavus.io/)➡️ $500 from Rime (https://www.rime.ai/)➡️ $1,000 from Layercode (https://layercode.com/)➡️ $500 from Cerebrium (https://www.cerebrium.ai/)➡️ $1,000 from Gladia (https://www.gladia.io/)➡️ Three free months from Coval (https://www.coval.dev/)➡️ $1,000 for Ultravox (https://fixie.ai)➡️ $50 from OpenPipe (https://openpipe.ai/)➡️ $500 from PlayAI (https://play.ai/)➡️ $500 from Baseten (https://www.baseten.co/)➡️ $1,000 from Freeplay (https://freeplay.ai/)➡️ $500 from Fireworks (https://fireworks.ai/)➡️ $500 from Deepgram (https://deepgram.com/)➡️ $500 from Vapi (https://vapi.ai)➡️ $100 from Groq (https://groq.com/)➡️ $500 from fal (https://fal.ai/)➡️ $1,000 from Pipecat Cloud (https://pipecat.daily.co/) Four weeks of presentations and hands-on sessions with industry leaders in realtime AI, including: Aidan Hornsby (Layercode). Batuhan Taskaya (fal). Brooke Hopkins (Coval). Charles Frye (Modal). Damien Tanner (Layercode). Dominik Kundel (OpenAI). Elizabeth Trykin (Vapi). Freddy Boulton (Hugging Face). Hamel H. (Parlance Labs). Hasssaan Raza (Tavus). Ian Cairns (Freeplay). Jean-Louis Quéguiner (Gladia). Joe Heitzeberg (AI Tinkerers). Jordan Dearsley (Vapi). Karan Goel (Cartesia). Kyle Corbitt (OpenPipe). Lily Clifford (Rime Labs). Mahmoud Felfel (PlayAI). Michael Louis (Cerebrium). Natalie Rutgers (Deepgram). Paige Bailey (Google DeepMind). Philip Kiely (Baseten). Prince Canuma (MLX hacker). Quinn Favret (Tavus). Rajiv Ayyangar (Product Hunt). Raymond Thai (Fireworks AI). Sam Stowers (Weights &amp; Biases). Shrestha Basu Mallick (Google DeepMind). Sean DuBois (OpenAI). swyx (Latent Space). Taranjeet Singh (mem0). Vaibhav Srivastav (Hugging Face). Zach Koch (Fixie.ai). Hear from people training models, designing APIs, and shipping AI agents at scale in production. Learn about the current state-of-the-art in voice AI for use cases like: ➡️ Customer support agents➡️ Outbound agents that quality sales leads➡️ Agents that answer the phone for restaurants, healthcare providers, and other small businesses➡️ Games and social experiences 1. Core technology and tooling for voice agents ➡️ Using transcription models, language models, and voice models➡️ Minimizing latency➡️ Managing multimodal context➡️ Turn detection and interruption handling➡️ Audio codecs, telephony integration, and network transport➡️ Voice AI evals➡️ Scripting and workflows➡️ Content guardrails➡️ Retrieval augmented generation and conversation memory➡️ Function calling for realtime AI, including how to handle async, parallel, and composite function calls 2. Deploying agents to production ➡️ Hosting➡️ Monitoring and observability 3. Plus special sections on ➡️ Realtime video➡️ Voice-enabled programming environments Listen to the Latent Space podcast about the course. https://www.youtube.com/watch?v=AbToUiWRhn4

Understand the core technologies driving voice AI today

You are an AI Engineer working on a conversational voice project.

You are a technical manager adding AI Voice to your organization's products.

You develop models and API and are exploring how to expand your realtime capabilities.

Who is this course for

What you’ll get out of this course

Understand the landscape of models and tools people are using to deploy voice agents to production, today.

Hear from labs developing the next generation of transcription, LLM, voice, and speech-to-speech models.

Build and deploy your own voice AI agent.

Attend hands-on workshops with developer relations engineers from the leading labs and infrastructure providers.

Explore the emerging areas of realtime conversational video and voice-enabled programming tools.

Provide a brief description for each module as a way to sell the value of what students will be learning throughout the course.

First Module

Second Module

Third Module

Course syllabus

What people are saying

Meet your instructor

Live presentations from people training models, developing APIs and tools, and shipping voice agents to production.

Live Presentations

Hands-on sessions and Q&amp;A opportunities with technical engineers from leading labs, infrastructure companies, and startups making interesting new tools.

Office Hours

Course schedule

This course builds on live workshops and hands-on projects

Active hands-on learning

You’ll be interacting with other learners through breakout rooms and project teams

Interactive and project-based

Join a community of like-minded people who want to learn and grow alongside you

Course completed by

About this course

Get notified about the next cohort

Learn from live sessions