Track 10: Training LLMs, Fine-Tuning Methods

QLoRA: Bigger Models on Small GPUs

Fine-tune a 4-bit model on a free GPU.

Status: Coming soon IntermediateVideo lessonAbout 12 min Free tools

Part of Train and Fine-Tune Models (28 of 45)

Get notified on YouTube Udemy certificate: coming soon

Course

Fine-Tune Your Own LLM (Free GPU, Step by Step)

Udemy: coming soon

Tools

Watch first

In this module

  1. Full Fine-Tuning vs Parameter-Efficient (PEFT)
  2. LoRA Explained and Applied
  3. QLoRA: Bigger Models on Small GPUs
  4. Your First Fine-Tune on Colab (Instruction Tuning)
  5. Make It Better: Data, Hyperparameters, Continued Pre-training, Multi-GPU

The course this lesson belongs to