Track 10: Training LLMs, Training Tools (One Lesson Each)

torchtune

Fine-tune with PyTorch-native recipes.

Status: Coming soon AdvancedVideo lessonAbout 12 min Free tools

Part of Train and Fine-Tune Models (38 of 45)

Get notified on YouTube

Course

Part of the free syllabus, not yet in a certificate course.

Udemy: coming soon

Tools

Watch first

In this module

  1. Hugging Face Transformers for Training
  2. Hugging Face TRL and PEFT
  3. Unsloth (and LLaMA-Factory)
  4. Axolotl
  5. torchtune