In 2023, Sander Schulhoff partnered with OpenAI, ScaleAI, and Hugging Face to run HackAPrompt, the 1st and Largest Generative AI Red Teaming competition ever held. Over 3,300 AI hackers from around the world competed to Prompt Inject various LLMs, forcing them to output "I have been pwned!" while bypassing increasingly difficult guardrails and prompt injection defenses. This competition generated the largest dataset of prompt injection attacks, which have most notably been used by OpenAI in their latest models to increase resistance to prompt injection attacks by up to 46%.

Sander categorized these attacks in his post-competition paper, Ignore This Title and HackAPrompt, which was awarded Best Theme Paper at EMNLP 2023, selected from over 20,000 submitted research papers. This paper has been cited twice by OpenAI: once in their Instruction Hierarchy paper and again in their Automated Red Teaming report.

Today, Sander Schulhoff is recognized as the leading expert in AI Red Teaming, and has delivered talks on HackAPrompt, Prompt Hacking, and AI Red Teaming at OpenAI, Stanford University, and Microsoft.

About the Course:

This 6-week Masterclass is the #1 AI Safety course designed for Cybersecurity Professionals, AI Safety Specialists, AI Product Managers, and GenAI Developers looking to master AI Red Teaming and protect their AI applications from malicious actors. In this course, you will learn about the vulnerabilities of Generative AI systems, including prompt injections, jailbreaks, and other adversarial attacks.

You'll work on hands-on exercises in the HackAPrompt playground, so you can practice attacking (and defending) AI models in a controlled environment. The course covers everything from understanding Generative AI threat landscapes to building strong defense mechanisms and ensuring compliance with security standards.

Finally, you will work on a final project to expose vulnerabilities in a live chatbot or your own AI application, putting your skills to the test. You'll learn directly from me alongside guest lectures from top experts in Generative AI security, and connect with others in the AI/ML red-teaming community along the way.

About the Instructor:

Sander Schulhoff is the Founder of Learn Prompting, the first prompt engineering guide ever released on the internet back in October 2022, which was one month before ChatGPT was released in November 2022. Since then, he’s trained over 3,000,000 people on Prompt Engineering, and has led Prompt Engineering workshops internally at OpenAI & Microsoft. He's an award-winning Generative AI researcher from the University of Maryland, and has authored research with OpenAI, Scale AI, Hugging Face, Stanford, The US Federal Reserve, and Microsoft. He is also the co-instructor of "ChatGPT for Everyone," a course created in partnership with OpenAI.

He organized HackAPrompt, the largest Generative AI Red Teaming competition ever, created in partnership with OpenAI, ScaleAI, & Hugging Face. Over 3,300 GenAI Hackers competed, and he collected 600,000 malicious prompts, making it the largest prompt injection dataset ever collected. This dataset has been used by every major LLM company, AI Security company, and multiple Government Agencies to date. He taxonomized the Prompt Injection attacks from this dataset and authored a post-competition paper, which won the Best Theme Paper award at EMNLP 2023—the world’s premier NLP conference—out of 20,000 submissions from researchers worldwide.

This paper was cited by OpenAI in their Instruction Hierarchy paper & their Automated Red Teaming paper, who used the dataset to make their models up to 46% more resistant to prompt injections (#1 security risk in LLMs).

Sander also recently led a team of researchers from OpenAI, Microsoft, Google, and Stanford University on The Prompt Report, the most comprehensive paper on prompting. This 76-page survey analyzed over 1,500 prompting papers, assessing the effectiveness of various prompting techniques, AI Agents, and Generative AI.

Sander has spoken and led workshops at Microsoft (one of their highest-attended internal workshops in 2024), OpenAI, and Stanford University. His Generative AI courses have trained over 3 million people, including thousands at Deloitte, Meta, Microsoft, and more.

In addition to Sander, this course will feature guest speakers in Generative AI and cybersecurity who will share real-world opportunities to apply your new AI/ML Red-Teaming skills:

• Jason Haddix: Over 20 years of experience in cybersecurity and AI as the CISO of Ubisoft, Head of Security at Bugcrowd, Director of Penetration Testing at HP, and Lead Penetration Tester at Redspin. He's currently ranked 57th all-time on Bugcrowd's bug bounty leaderboards, and has spoken at conferences like DEF CON, Bsides, Black Hat, RSA, OWASP, Nullcon, SANS, IANS, BruCon, ToorCon, and many more.

• Pliny the Prompter: The most renowned AI Jailbreaker, who has successfully jailbroken every AI model released to date—including OpenAI’s o1, which hasn’t even been made public! Pliny was also able to jailbreak an AI agent to sign into gmail, code ransomware, compress it into a zip file, write a phishing email, attach the payload, and successfully deliver it to the target. 

• Johann Rehberger: Led the creation of a Red Team in Microsoft Azure as a Principal Security Engineering Manager and built the Red Team at Uber. Johann discovered attack vectors like ASCII Smuggling and AI-powered C2 (Command and Control) attacks. He's also discovered Bug Bounties in OpenAI’s ChatGPT, Microsoft Copilot, GitHub Copilot Chat, Anthropic Claude, & Google Bard/Gemini. Johann will be sharing unreleased information which he hasn't yet shared in his blog, https://embracethered.com/

• Joseph Thacker: Principal AI Engineer at AppOmni, who leads the AI team in developing novel AI features, including agentic functionality and retrieval systems. He's a security researcher who specializes in application security and AI, with over 1,000 vulnerabilities submitted across HackerOne and Bugcrowd. Joseph also hacked into Google Bard at their LLM bug bounty event, and secured 1st place in the competition!

• Akshat Parikh: Ex-AI security researcher at a startup backed by OpenAI and DeepMind researchers, Top 21 in JP Morgan’s Bug Bounty Hall of Fame, and Top 250 in Google’s Bug Bounty Hall of Fame... at 17 years old!

• Richard Lundeen: Principal Software Engineering Lead for Microsoft’s AI Red Team and maintainer of Microsoft PyRit. He leads an interdisciplinary team of red teamers, machine learning researchers, and developers.

• Sandy Dunn: A seasoned CISO with 20+ years of experience in healthcare. Project lead for the OWASP Top 10 Risks for LLM Applications Cybersecurity and Governance

Plus free access to Learn Prompting Plus (a $549 value): Gain immediate access to over 15 comprehensive courses—including this masterclass and additional courses in Prompt Engineering, Prompt Hacking, & AI/ML Red-Teaming (valued at $299), and a voucher for the Learn Prompting AI/ML Red-Teaming Certificate Exam (valued at $249). 

Exclusive Benefit: Upon completing our course and passing the AI/ML Red-Teaming Certification exam, you'll be added to a special job board on our website, giving you access to exclusive red-teaming and AI security job opportunities.

LIMITED SPOTS AVAILABLE

We're keeping this class intentionally small and will cap it at 100 participants so that we can provide more personal attention to each of you to make sure you get the most out of the course. If you're unable to place your order and see the waitlist page, that means we sold out this cohort. If so, please join our waitlist to get notified when we release our next cohort.

Money-Back Guarantee

We genuinely want this course to be transformative for you. You can receive a full refund within 14 days after the course ends, provided you meet the completion criteria in our refund policy. We're confident in the value we provide and stand by our promise to help you level up your AI security expertise.

Interested in an enterprise license so your whole team or company can take the course? Please reach out directly to team@learnprompting.org