Track 10: Training LLMs, Fine-Tuning Methods

Full Fine-Tuning vs Parameter-Efficient (PEFT)

Know why LoRA fits on one GPU.

Status: Coming soon BeginnerVideo lessonAbout 12 min Free tools

Part of Train and Fine-Tune Models (26 of 45)

Get notified on YouTube Udemy certificate: coming soon

Course

Fine-Tune Your Own LLM (Free GPU, Step by Step)

Udemy: coming soon

Tools

Watch first

Then try

In this module

  1. Full Fine-Tuning vs Parameter-Efficient (PEFT)
  2. LoRA Explained and Applied
  3. QLoRA: Bigger Models on Small GPUs
  4. Your First Fine-Tune on Colab (Instruction Tuning)
  5. Make It Better: Data, Hyperparameters, Continued Pre-training, Multi-GPU

The course this lesson belongs to