Track 10: Training LLMs, Fine-Tuning Methods
Make It Better: Data, Hyperparameters, Continued Pre-training, Multi-GPU
Run a second training that beats the first.
Part of Train and Fine-Tune Models (30 of 45)
Get notified on YouTube Udemy certificate: coming soon
Course
Fine-Tune Your Own LLM (Free GPU, Step by Step)
Udemy: coming soon
Tools
- Unsloth (open-source, free)
- Weights & Biases (freemium)
Watch first
In this module
- Full Fine-Tuning vs Parameter-Efficient (PEFT)
- LoRA Explained and Applied
- QLoRA: Bigger Models on Small GPUs
- Your First Fine-Tune on Colab (Instruction Tuning)
- Make It Better: Data, Hyperparameters, Continued Pre-training, Multi-GPU
The course this lesson belongs to