Modern Natural Language Processing with GPT-4 & more
4.5
(3 ratings)
2 Weeks
·Cohort-based Course
See how companies like OpenAI create large language models like BERT and GPT-3 and learn how to use GPT-3 and ChatGPT to create NLP products
Modern Natural Language Processing with GPT-4 & more
4.5
(3 ratings)
2 Weeks
·Cohort-based Course
See how companies like OpenAI create large language models like BERT and GPT-3 and learn how to use GPT-3 and ChatGPT to create NLP products
Course overview
Master Large Language Models in 2 weeks
Build fair NLP pipelines with modern techniques and architectures through a unique hands-on approach.
Who is this course for
01
NLP / Machine Learning Engineers who want to learn about modern large language models.
02
Data Scientists looking to reduce bias in their NLP pipelines.
03
AI enthusiasts exploring NLP to build fun projects!
What you will do
Build a robust information retrieval system and Q/A system
Use S-BERT to index documents at scale and both GPT and BERT to answer questions given indexed documents.
Build multi-task NLP pipelines
Use GPT and other causal language models to perform both sentiment analysis and abstractive summarization at once using the same training dataset
Prompt Engineering with GPT-3 and chatGPT
Learn the fundamentals of prompt engineering to get the most out of the state of the art models GPT-3 and chatGPT
Modern Natural Language Processing with GPT-4 & more
See what people are saying
Kene Anoliefo
.JPG&w=1536&q=75)
Luna Olavarria Gallegos
Meet your instructor
Sinan Ozdemir
Author, lecturer, and entrepreneur
Sinan is an experienced teacher, engineer, author, and entrepreneur.
- He has written 5 books about Data Science and Machine Learning
- He was an adjunct lecturer for The Johns Hopkins University teaching Data Science
- He started and sold Kylie.ai, a company dedicated to providing top-tier automations for Fortune 100 companies
- He lectures for O'Reilly and Pearson on Large Language Models
- He advises for VCs up and down the west coast on AI strategy, defensibility, and implementation
Be the first to know about upcoming cohorts
Modern Natural Language Processing with GPT-4 & more
Course syllabus
01
Introduction to Large Language Models
Learn the history of modern NLP from the introduction of deep learning in solve language tasks to language modeling and the modern Transformer architecture
02
Natural Language Understanding with BERT
We will dissect the BERT architecture and the scaled dot product attention formula to understand how the encoder stack of the Transformer can be used to achieve state of the art results for Natural Language Understanding (NLU) tasks.
03
Natural Language Generation with FLAN-T5 & GPT
We will dissect the T5 and GPT architecture and see how the altered masked attention formula makes the decoder stack of the Transformer able to achieve state of the art results for Natural Language Understanding (NLU) tasks.
We use the GPT-3 API to solve NLP tasks and fine-tuning FLAN-T5 on a custom dataset
04
Prompt Engineering for GPT3 and ChatGPT
We will learn the fundamentals of prompt engineering to get the best results from GPT-3 and chatGPT's outputs.
We Fine-tune GPT-3 and use Embeddings and DALL-E 2 to create a compelling prototype
Course schedule
4-6 hours per week
Twice a week
8:00am - 10:00am PT
Sessions are twice a week for two hours each. Each session will have breaks and Q/A baked in.
Weekly office hours
1 hour per week
We will have at least one office hour a week where you can ask me anything about our course or something AI related. I'd love to hear about what you're working on and even pair program!
Be the first to know about upcoming cohorts
Modern Natural Language Processing with GPT-4 & more
Learning is better with cohorts
Build powerful NLP pipelines
Learn how to create powerful Natural Language Processing (NLP) pipelines using the latest language models like BERT and GPT
Interactive and project-based
You’ll be interacting with other learners through breakout rooms and project teams to discover the potential of GPT-3 to create state-of-the-art NLP pipelines.
See how OpenAI does it
Gain an understanding of how OpenAI pre-trains and fine-tunes language models for use in various applications.
Use GPT-3 Today!
Learn how to integrate language models into existing applications and create new ones.