Track 10: Training LLMs, Small Models From Scratch

How a GPT Is Built, End to End

Explain every stage from text to chatbot.

Status: Coming soon BeginnerVideo lessonAbout 13 min
Get notified on YouTube Udemy certificate: coming soon

Course

Transformers & GPT From Scratch for AI Engineers

Udemy: coming soon

Watch first

Then try

In this module

  1. How a GPT Is Built, End to End
  2. Build a BPE Tokenizer
  3. Build and Train a Toy GPT
  4. Train a Small Language Model on Colab

The course this lesson belongs to