Track 10: Training LLMs, Training Tools (One Lesson Each)

Hugging Face Transformers for Training

Load, tokenize and train with Trainer.

Status: Coming soon BeginnerVideo lessonAbout 12 min Free tools

Part of Train and Fine-Tune Models (34 of 45)

Course

Part of the free syllabus, not yet in a certificate course.

Udemy: coming soon

Tools

Watch first

Then try

In this module

  1. Hugging Face Transformers for Training
  2. Hugging Face TRL and PEFT
  3. Unsloth (and LLaMA-Factory)
  4. Axolotl
  5. torchtune