Track 11: ML and Deep Learning Foundations for AI Engineers
Transformers & GPT From Scratch for AI Engineers
24 lessons
Track 10: Training LLMs, Small Models From Scratch
Train a Small Language Model on Colab
Pre-train and evaluate a small LM on a curated corpus.
Get notified on YouTube Udemy certificate: coming soon
Course
Transformers & GPT From Scratch for AI Engineers
Udemy: coming soon
Tools
- PyTorch (open-source, free)
- Google Colab (freemium)
- Hugging Face Datasets (open-source, free)
Watch first
In this module
- How a GPT Is Built, End to End
- Build a BPE Tokenizer
- Build and Train a Toy GPT
- Train a Small Language Model on Colab
The course this lesson belongs to