Atelier Galita

5 problèmes dans ta conception pédagogique

Nicolas Galita

Formateur et ingénieur pédagogique depuis plus de 12 ans

On discute des problèmes les plus courants et on donne des débuts de solution

Les erreurs les plus courantes dans le design pédagogique

Les 3 étapes de la méthode et comment tu vas l'appliquer pendant le Bootcamp

Rappel du plan du Bootcamp APS

C'est le moment de discuter de tout : logistique, contenus, autre...

Pose n'importe quelle question sur le bootcamp

Hey! I'm Dr. Phil and I'm excited to invite you to my four-week blended bootcamp to get ahead of the AI curve and learn how to use AI to optimise the efficiency and effectiveness of your learning design process. Each week, you'll complete an async project (~90 mins) and join me for a 1hr live debrief &amp; exploration class. Together, we'll transform the velocity &amp; impact of your learning analysis, design, development, implementation &amp; evaluation process with AI. The Overview In this four-week bootcamp, you'll complete 4 x hands-on projects: Week 1: AI-Powered Analysis- Test multiple cutting-edge AI use cases for analysis.- Learn how to use AI to conduct evidence-based needs analysis faster and with greater accuracy.- Test how AI impacts the speed &amp; quality of instructional analysis.- Master evidence-based prompting—the secret to getting high-quality AI-generated outputs in instructional design. Week 2: AI-Powered Design- Discover how AI can enhance the design part of your process.- Explore how to use AI to access research-backed strategies &amp; optimise course design with AI.- Use AI to build a virtual SME and develop knowledge and skills maps, learning objectives &amp; course outlines. Week 3: AI-Powered Development &amp; Implementation- Use AI tools to create engaging multimedia content (videos, images, assessments, simulations).- Leverage AI for rapid prototyping and course development.- Design effective AI-powered review, coaching and feedback systems. Week 4: AI-Powered Evaluation- Master AI-enhanced learning evaluation techniques.- Use AI to measure ROI, learner engagement, and business impact.- Learn to refine and optimise training based on AI-driven analytics. Bonus: Implementation Week (no live class)- Get continued access to the course materials, community and Phil for a bonus week to get advice, feedback and help transfer your learning into practice._____ How it Works: - Projects are released in the community on. Monday morning.- Projects are completed between Mon and Thurs PM (UK)- We meet at a 1hr live class each Friday to explore our projects and try more AI use cases. Throughout, Phil is available in the community to take questions and give feedback. _____ Cohort &amp; Live Class Details Class of May 2025: May 12—June 6, 2025Weekly live classes on Fridays @ 8-9 AM UK Class of June 2025: June 23—July 18, 2025Weekly live classes on Fridays @ 4-5 PM UK

“All learning designers will be AI-enhanced learning designers in the future"

<ul><li>Test multiple cutting-edge AI use cases for analysis.</li><li>Learn how to use AI to conduct evidence-based needs analysis faster and with greater accuracy.</li><li>Test how AI impacts the speed &amp; quality of instructional analysis.</li><li>Master evidence-based prompting—the secret to getting high-quality AI-generated outputs.</li></ul>

Week 1 - AI-Powered Analysis 

<ul><li>Discover how AI can enhance the design part of your process.</li><li>Explore research-backed strategies to optimise course design with AI.</li><li>Use AI to build a virtual SME, develop knowledge and skills maps, learning objectives &amp; course outlines. </li></ul>

Week 2 - Project 2: AI-Powered Design

<ul><li>Use AI tools to create engaging multimedia content (videos, images, assessments, simulations).</li><li>Leverage AI for rapid prototyping and course development.</li><li>Design effective AI-powered coaching and feedback systems.</li></ul>

Week 3 - Project 3: AI-Powered Development & Implementation

<ul><li>Master AI-enhanced learning evaluation techniques.</li><li>Use AI to measure ROI, learner engagement, and business impact.</li><li>Learn to refine and optimize training based on AI-driven analytics.</li></ul>

Week 4 - Project 4: AI-Powered Evaluation

Four Weeks, Four Projects, One End to End Instructional Design Experience: Powered By AI + Learning Science

🗄️ Project Outcome: You will learn how use AI to accelerate &amp; augment your analysis process: how can AI help us to us define what to design? 🧳 Use Cases: include AI-powered needs analysis &amp; simulating learner interviews.

Week 1, Project 1: AI-Powered Analysis  

🗄️ Project Outcome: You will learn how use AI to accelerate &amp; augment your design process: how can AI help us to us define how to design? 🧳 Use Cases: include AI-powered ZPD definition &amp; outline creation.

Week 2, Project 2: AI-Powered Design

🗄️ Project Outcome: You will learn how use AI to accelerate &amp; augment your delivery: how can AI help us to build learning content &amp; evaluate its impact on learning and business outcomes? 🧳 Use Cases: include AI-powered content creation &amp; the creation of an AI tutor-bot.

Week 3, Project 3: AI-Powered Development & Implementation

🗄️ Project Outcome: You will learn how to use AI to accelerate and augment both formative &amp; summative evaluation. 🧳 Use Cases: include building an AI-powered evaluation bot &amp; using AI to analyse evaluation data. I will be in the community throughout to support you!

Week 4, Project 4: AI-Powered Evaluation

Course schedule

Learning Designers - you want to stay ahead of the curve &amp; leverage AI to optimise your efficiency &amp; impact on learners

L&amp;D Professionals - you want to optimise org performance by taking an evidence-based, AI-powered approach to workplace training design

Academics &amp; Teachers - you want adopt an evidence-based design approach to learning design process &amp; stay ahead of the AI curve

Who is this course for?

Bootcamp Summary

I'll show you the most powerful and up-to-date AI tools for educators &amp; instructional designers, all pre-tried &amp; tested by me. You'll get hands-on experience with 50 state-of-the-art AI tools specially curated for each step of the instructional design process.

Integrate Cutting-Edge AI into Your Course Design & Delivery
 

You'll master both structured and conversational prompting techniques to get the best results from a range of up to date AI models.

Become a Prompting Pro

You'll choose from 50 cutting-edge use cases and ship 4 AI projects, receiving feedback from me and your peers as you go.

Hands-On By Design

I believe in communities, not islands. You'll join a carefully curated cohort of like-minded people, support one another, hold one another to account &amp; build your network as well as your knowledge &amp; skills.

Connected By Design

Learn once, rinse &amp; repeat. You'll leave with the tools, prompts, use cases and skills you need to be ahead of the AI curve and optimise your process for both efficiency and effectiveness using AI.

Take-Away Skills for Life

The #1 AI- Bootcamp for people who design & develop learning & training, led by LinkedIn Top Voice, Dr Phil 

Class of April 2025

Dr Philippa Hardman 

Creator - DOMS™️ | AI Expert | Cambridge Scholar | Chief Academic Officer | TEDX Speaker, AI & Education

Class of March 2025 

Class of May 2025

Design Thinking is a creative approach to finding clarity amidst ambiguity. In this course, you'll be guided through how to apply Design Thinking to your own career exploration. The course itself is broken down into four sessions: Ground, Diverge, Converge, and Plan which will help you articulate your values, explore the career possibilities available to you, design experiments to figure out what you want, and plan your short, medium, and long-term next steps. You'll walk away with more confidence about what you want next and a roadmap for how to get there.

Clarify what you want with the help of Design Thinking

Our course starts by grounding in where you're at today. Through a series of exercises, you'll reflect on your unique values, career experiences, and visions for your future. By the end, you'll be able to clearly articulate what matters most to you in your next step.

Ground

This session is all about going wide. You'll canvas out three potential paths for yourself, quiet your inner critic, and ask what would have to be true in order to pursue each. By the end, you'll have three distinct paths and a research plan.

Diverge

This session is all about making decisions. You'll synthesize what you've learned from your research and address some of your fears in making changes in your life. By the end, you'll clarify the direction you want to keep exploring.

Converge

Here's where the rubber meets the road. You'll make an action plan with short, medium, and long-term goals, and find accountability within the rest of the group. We'll talk about addressing the inevitable barriers along the way, and you'll leave with clarity and conviction for what's next.

Course syllabus

Our course starts by grounding in where you are. Through a series of exercises, you'll reflect on your values, career experiences, and visions for your future. By the end, you'll be able to articulate what matters to you in your next step. *All live sessions will be recorded.

Module 1: Ground

Module 2: Diverge

Module 3: Converge

Here's where the rubber meets the road. You'll make an action plan with short, medium, and long-term goals, and design methods of accountability. We'll talk about addressing the inevitable barriers along the way, and you'll leave with clarity and conviction for what's next.

Module 4: Plan

Almost all coursework will take place during the live sessions, but there will be optional resources to continue exploring outside of class. *There will also be the (optional) opportunity to meet 1:1 with Simone

Weekly projects

Curious explorers who are ready for a change in their life but aren't clear on exactly what they're looking for

Overworked professionals who move a mile-a-minute but don't have the space to take a step back and reflect

Passionate generalists who feel pulled in multiple directions but aren't sure which path they want to choose

Who is this course for

Key outcomes

The North Star of this course is for you to go from messiness to clarity. We'll explore different frameworks for clarifying your personal values and career possibilities. You will walk away with conviction for what you really want from the next step in your work and life

A clear vision for the next step in your work/life

This course is actionable. From day one you will be envisioning, prototyping, and refining your path. You will leave with an air-tight action plan for the steps to take to keep progressing and resources that you can return to throughout your career.

An action plan with the short, medium, and long-term steps to achieve your vision

Accountability is everything. In this course you will connect with other folks who are in similar places on the journey. The relationships you form will extend long beyond the last day of class.

A vibrant community of other ambitious professionals to hold you accountable

In the course, you will receive a workbook filled with evergreen exercises, reflection prompts, and resources that you can dust off whenever you find yourself at a similar crossroads.

A buffet of research, exercises, and resources that you can return to again and again

Instead of spinning your wheels, follow a step-by-step process to determine what you value and plan your next move.

Simone Stolzoff

Cohort 8

Cohort 9

Is this happening to you or your teams? 🔥 Feeling marginalized as a designer within the organization (compared to business &amp; tech voices) 🔥 Struggling to find support (time, budget, late stakeholder involvement, etc.) 🔥 Encountering risk aversion to pursuing big ideas with new, innovative approaches 🔥 Fighting through the organization's resistance to change while the market is quickly evolving Design represents an important voice in shaping the future, but it can't operate in a vacuum. The complexities of our time (e.g., generative AI, economic uncertainty, climate change, cultural movements, etc.) require multidisciplinary, creative problem-solving more than ever. If your a design practitioner or design leader, this course will give you more courage (vs. paralysis) in your work. You'll figure out ways to break through the glass ceiling of misunderstanding and friction when collaborating with tech and business peers. You'll learn ways to build stakeholder empathy, strategic influence and a renewed sense of optimism that you can translate diverse insights and inspiration into meaningful innovation. What we'll cover together: • Debunk design's misperceptions and explore the ways designers can influence up and down the value chain• Optimize multidisciplinary teaming by building effective stakeholder management skills when engaging business &amp; tech colleagues• Develop future foresight by learning how to curate trends and anticipate many possible (even plausible) future scenarios• Exploring the connections between design &amp; diversity to give you strategies to evolve your team to mirror the world and its needs• Foster design transformation by understanding implications on your organization's design roles, methods and key enablers This live 2-week interactive course, inspired from my first book Reimagining Design (The MIT Press), provides a safe-space to share perspectives, frameworks and tactics on how to elevate design's impact within multidisciplinary teams to unlock meaningful innovation and inspire future growth opportunities for your organization. "Chatham House Rules" apply for each live-session and any asynchronous conversations on the Maven platform. Why do I want to serve as your instructor? I want to share tips and tricks that will help you cut through the organizational noise and friction that often gets in our way of making impact with our design skills. From my experience building, growing and serving creative teams at places like Nike and BCG, I want you to get up the learning curve much faster.

Feeling stuck on your big idea? Don't go it alone. Multidisciplinary is the way!

Provide a brief description for each module as a way to sell the value of what students will be learning throughout the course.

First Module

Second Module

Third Module

Meet your cohort and understand what to expect.

1 Live Welcome Session on April 28th

Get together with Kevin Bethune and your cohort peers for live interactive discussion and sharing of perspectives.

2 Consecutive Live-Sessions on Saturdays

Our second cohort will embark on two live, interactive sessions with asynchronous lesson material and projects before and in between, as well as having resources to continue explorations after the course concludes.

May 3rd & 10th, 2025

We'll provide exercises for students to perform their own independent investigations on where design, creativity and/or innovation questions could be applied to their day-to-day realities. They will have opportunities to bring their findings back into the next live session.

Experienced Design Practitioners who want to increase their influence and open their aperture to spot holistic, innovation opportunities.

Design Leaders who seek new ways to empower and strategically align their design teams to operate at parity alongside other disciplines.

Senior Level Executives in design adjacent roles (e.g., Product Management, Engineering, Strategy) who also influence the creative process.

Who is this course for ...

What you’ll get out of this course ...

Explore innovation opportunities through new lenses that will open your creative aperture. Develop ways to strengthen your creative influence, and include non-designers by fostering their ability to make creative sparks and connections across diverse insights and inspirations.

A playbook to guide your creative problem-solving as design leaders positioned at parity within multidisciplinary teams

Investigate the paradigms that influence our converging, hyper-connected world and draw inspiration from immersing in diverse resources. These paradigms may include newly emerging technologies, trends and exemplars (e.g., startups, research institutes) to curate and study.

Key frameworks that help you find diverse inputs, insights and inspirations that can help improve your team's future foresight

Understand the key shifts in role clarity, process and enablers necessary to demonstrate design's potential within your organization. Learn how to drive influence by ensuring design's contributions are closely aligned to the goals and critical needs of the business.

A holistic approach to guide your ongoing investment in design capabilities, requiring stakeholder and transition management

Imagine yourself in this opportunity by using our interactive, peer discussions as a mirror to see how you might engage multidisciplinary teams in new ways. Develop ways to lead differently as we exchange hard lessons together. Your voice matters in the work!

Key perspectives on how to evolve your design career in support of reimagining design's potential to unlock meaningful innovation

Meet your peers via our live interactive discussions on Zoom. Learn and build together, share feedback and compare notes with each other. You will be able to tap into your cohort after the course ends. Let's have some fun through every step!

A network of creative peers and leaders to elevate your impact

Drive breakthrough innovation using creative problem-solving techniques and effective stakeholder management with multidisciplinary teams.

Kevin Bethune

Founder & Chief Creative Officer, dreams • design + life  |  Best-selling Author, Reimagining Design

Cohort 3

Cohort 4

Do you catch yourself asking any of the following questions while building AI applications? 1. How do I test applications when the outputs are stochastic and require subjective judgements? 2. If I change the prompt, how do I know I'm not breaking something else? 3. Where should I focus my engineering efforts? Do I need to test everything? 4. What if I have no data or customers, where do I start? 5. What metrics should I track? What tools should I use? Which models are best? 6. Can I automate testing and evaluation? If so, how do I trust it? If you aren't sure about the answers to these questions, this course is for you. This is a hands-on course for engineers and technical PMs. Ideal for those who are comfortable coding or vibe coding. ---WHAT TO EXPECT This course will provide you with hands-on experience. Get ready to sweat through exercises, code and data! We will meet two times a week for four weeks, with generous office hours (read below for course schedule). We will also hold office hours and host Discord community where you can communicate with us and each other. In return, you will be rewarded with skills that will set you apart from the competition by a wide margin. (see testimonials below). All sessions will be recorded and available to students asynchronously.--- COURSE CONTENT Lesson 1: Fundamentals &amp; Lifecycle LLM Application Evaluation- Why evaluation matters for LLM applications - business impact and risk mitigation- Challenges unique to evaluating LLM outputs - common failure modes and context-dependence- The lifecycle approach from development to production- Basic instrumentation and observability for tracking system behavior- Introduction to error analysis and methods for categorizing failures Lesson 2: Systematic Error Analysis- Bootstrap data through effective synthetic data generation- Annotation strategies and quantitative analysis of qualitative data- Translating error findings into actionable improvements- Avoiding common pitfalls in the analysis process- Practical exercise: Building and iterating on an error tracking system Lesson 3: Implementing Effective Evaluations- Defining metrics using code-based and LLM-judge approaches- Techniques for evaluating individual outputs and overall system performance- Organizing datasets with proper structure for inputs and reference data- Practical exercise: Building an automated evaluation pipeline Lesson 4: Collaborative Evaluation Practices- Designing efficient team-based evaluation workflows- Statistical methods for measuring inter-annotator agreement- Techniques for building consensus on evaluation criteria- Practical exercise: Collaborative alignment in breakout groups Lesson 5: Architecture-Specific Evaluation Strategies- Evaluating RAG systems for retrieval relevance and factual accuracy- Testing multi-step pipelines to identify error propagation- Assessing appropriate tool use and multi-turn conversation quality- Multi-modal evaluation for text, image, and audio interactions- Practical exercise: Creating targeted test suites for different architectures Lesson 6: Production Monitoring &amp; Continuous Evaluation- Implementing traces, spans, and session tracking for observability- Setting up automated evaluation gates in CI/CD pipelines- Methods for consistent comparison across experiments- Implementing safety and quality control guardrails- Practical exercise: Designing an effective monitoring dashboard Lesson 7: Efficient Continuous Human Review Systems- Strategic sampling approaches for maximizing review impact- Optimizing interface design for reviewer productivity- Practical exercise: Implementing a continuous feedback collection system Lesson 8: Cost Optimization- Quantifying value versus expenditure in LLM applications- Intelligent model routing based on query complexity- Practical exercise: Optimizing a real-world application for cost efficiency ---FREE CREDITSEach student will get $1,000 of of free Modal (https://modal.com/) compute credits. ---GUEST SPEAKERS 1. Kwindla Kramer: Founder of pipecat, an OSS framework for voice and conversational AI. - How to eval voice agents.2. JJ Allaire: Inspect, a OSS eval toolset used by Anthropic, Groq and other leading companies.3. Aarush Sah: Head of Evals at Groq4. Benjamin Clavié: Common RAG mistakes &amp; how to diagnose them.5. Isaac Flath: Building custom annotation tools for error analysis with FastHTML

Eliminate the guesswork of building AI applications with data-driven approaches.

If your events are recurring and at the same time, it might be easiest to use a single line item to communicate your course schedule to students

Monday & Wednesday & Friday

Feel free to type out dates as your title as a way to communicate information about specific live sessions or other events.

May 7, 2022

Schedule items can also be used to convey commitments outside of specific time slots (like weekly projects or daily office hours).

Engineers &amp; Technical PMs building AI applications who have little experience with machine learning or data science.

Those interested in moving beyond vibe-checks to data driven measurements you can trust, even when outputs are stochastic or subjective.

Founders and leaders who are unsure of the failure modes of their AI applications and where to allocate resources.

Who this course is for

What you’ll get out of this course

We've tried all of them so you don't have to.

Acquire the best tools for finding, diagnosing, and prioritizing AI errors.

And how to best leverage data when you do have users.

Learn how to bootstrap with synthetic data for testing before you have users

Data flywheels ensure you have examples to draw from for prompts, tests, and fine-tuning.

Create a data flywheel for your applications that guarantees your AI will improve over time.

How can you really trust LLM-as-a-judge? How should you design them? We will show you how. We will also show you how to refine prompts, generate metadata, and other tasks with the assistance of AI.

Automate parts of your AI evaluation with approaches that allow you to actually trust and rely on them.

We will show you approaches to discover all the ways AI is not performing

Ensure your AI is aligned to your preferences, tastes and judgement.

There are an infinite number of things you can try, tests you can write, and data you can look at. We will show you a data-driven process that helps you prioritize the most important problems so you can avoid wasting time and money.

Avoid common mistakes we've seen across 35+ AI implementations.

We will provide end-to-end exercises, examples and code to make sure you come away with the skills you need. We will NOT just throw a bunch of slides at you!

Hands-On Exercises, Examples and Code

Generous office hours ensures students can ask questions about their specific issues and interests.

Personalized Instruction

Learn proven approaches for quickly improving AI applications.  Build AI that works better than the competition, regardless of the use-case.

Lightning Lessons

5 problèmes dans ta conception pédagogique