Stefania Druga

Cohort 1

Regular

I am teaching this class again. Iwill be updating the tools, models, and technologies we are using 

Multimodal AI November 

This&nbsp;<a href="https://maven.com/p/044a90/multimodal-ai-prototyping-with-tldraw-excalidraw?utm_medium=ll_share_link&amp;utm_source=instructor" rel="noopener noreferrer" target="_blank">live meeting</a>&nbsp;which took place on June 13th 2025, explored the exciting world of multimodal AI prototyping, featuring demonstrations of tools like&nbsp;Excalidraw&nbsp;and&nbsp;tldraw. These platforms are at the forefront of combining visual and text-based interfaces to create AI-assisted design and coding experiences. The session’s presenters,&nbsp;Christopher Chedeau&nbsp;(founder of&nbsp;<a href="https://excalidraw.com/" rel="noopener noreferrer" target="_blank">Excalidraw</a>) and&nbsp;Steve Ruiz&nbsp;(founder of&nbsp;<a href="https://www.tldraw.com/" rel="noopener noreferrer" target="_blank">tldraw</a>), showcased a variety of AI-powered applications, from real-time drawing interpretation to automated code generation. Moderated by&nbsp;Stefania Druga&nbsp;

Making thinking visible: Multimodal AI Prototyping
 

Create Voice, Vision & Sensors-powered AI Apps in 14 Day—no ML expertise required. 
 

Hands-On Multimodal AI: Build Your First Interactive Apps

Product Management

Sr. User Researcher

product manager

Sr Director

The Problem We're Solving Everyone’s cheering Gemini, GPT-4V and other Multimodal AI demos, yet most tutorials stop at “Hello World.” You watch demos of AI that can see sketches and understand gestures, but the gap between inspiration and implementation feels insurmountable. Meanwhile, stakeholders are presented with a significant opportunity to capitalize on the expanding market in multimodal AI. Why This Course Is Different:* Expert in your corner: Learn from someone building these systems at Google DeepMind, live workshops + Slack hotline with me.* Hands-on focus : Walk away with 3 functional prototypes built based on project guides* Discover best practices – Master tools that work fast and reliably( Google AI Studio and the Gemini API ecosystem) and learn how to use frameworks that run on devices (llama.cpp, Ollama).* Tiny Cohort, Big accountability: Max 35 students, peer reviews, demo day. Get personalized feedback and tight accountability. In just two weeks you’ll be shipping portfolio-ready apps that prove you can harness multimodal AI—even on a phone with no prior experience needed.&nbsp;

Course syllabus

If your events are recurring and at the same time, it might be easiest to use a single line item to communicate your course schedule to students

Tuesdays & Thursdays

Feel free to type out dates as your title as a way to communicate information about specific live sessions or other events.

May 7, 2022

Schedule items can also be used to convey commitments outside of specific time slots (like weekly projects or daily office hours).

Weekly projects

Course schedule

Mid-Career Pivoters: Professionals (e.g. Marketing) seeking AI roles. Lack build experience, find ML theory dense. Need practical AI skills.

Designers/Creatives: UX/UI designers wanting AI in prototypes (voice, vision). Think coding is a barrier. Aim to rapidly build via APIs.

Product Managers: PMs needing to grasp multimodal APIs beyond text to define/prototype new AI-powered product features (voice, image).

Who is this course for

What you’ll get out of this course

Go from feeling intimidated about AI to confidently creating your own simple, interactive multimodal applications using provided templates and bespoke no-code tools for using APIs for vision, voice, and other sensors.

Demystify Multimodal AI & Start BUILDING

Learn to take a cool ideas, perhaps inspired by novel AI ability to understand sketches or analyze video, and quickly build a working proof-of-concept. Think: a voice-activated note-taker, a gesture-controlled music player, or a tool that describes images aloud.

Rapidly Prototype Your AI Ideas

Showcase concrete, project-based experience with modern multimodal AI, crucial for career pivots or leveling up. You’ll leave with tangible projects and the empowerment to continue exploring.

Add Tangible AI Skills to Your Resume/Portfolio

Understand multimodal AI's real-world capabilities and limits to confidently discuss ideas, evaluate tools, and guide AI projects. Discover why effective interaction design—how vision, voice, and sensors work together—is often more crucial for success than just model accuracy.

"Speak AI" More Fluently & Design Better Interactions

MIT research group

DeepMind

Google

Microsoft

Multimodal AI Prototyping with tldraw & Excalidraw

Independent Researcher (former Scientist at Google DeepMind)

Steve Ruiz

Developer, designer, and the founder of tldraw

Christopher Chedeau

Co-creator of Prettier and React Native, creator of Excalidraw

Discover how to leverage creative AI canvases to quickly build and iterate on multimodal prototypes.

Rapid Prototyping with AI

Get a firsthand look at how to use tldraw's innovative AI canvas to turn ideas into functional prototypes.

Intro to tldraw's "computer"

Learn tips and tricks for using the popular open-source whiteboard tool, Excalidraw, for collaborative prototyping

Mastering Excalidraw

Unlock Multimodal AI: Intro to Interactive App Ideas

Research Scientist @Google DeepMind

Understand what practical multimodal AI means and see simple examples of apps using vision, voice, and sensors data.

Build Your First Multimodal AI App

Get a peek at how accessible AI tools and APIs can help you start building your own interactive experiences.

Create Interactive Multimodal AI Apps

See a showcase of multimodal AI demo ideas (from household helpers to creative tools) to ignite your imagination.

Learn directly from Stefania Druga

Stefania Druga

Courses

Hands-On Multimodal AI: Build Your First Interactive Apps

Lightning Lessons

Multimodal AI Prototyping with tldraw & Excalidraw

Unlock Multimodal AI: Intro to Interactive App Ideas

Resources

Making thinking visible: Multimodal AI Prototyping