Track 11: ML and Deep Learning Foundations for AI Engineers
Transformers & GPT From Scratch for AI Engineers
24 lessons
Track 10: Training LLMs, Small Models From Scratch
Build and Train a Toy GPT
Train a tiny GPT that writes in a style.
Get notified on YouTube Udemy certificate: coming soon
Course
Transformers & GPT From Scratch for AI Engineers
Udemy: coming soon
Tools
- PyTorch (open-source, free)
- nanoGPT-style code (open-source, free)
- Google Colab (freemium)
Watch first
Then try
In this module
- How a GPT Is Built, End to End
- Build a BPE Tokenizer
- Build and Train a Toy GPT
- Train a Small Language Model on Colab
The course this lesson belongs to