Track 10: Training LLMs, Training Tools (One Lesson Each)
Hugging Face Transformers for Training
Load, tokenize and train with Trainer.
Part of Train and Fine-Tune Models (34 of 45)
Course
Part of the free syllabus, not yet in a certificate course.
Udemy: coming soon
Tools
- Hugging Face Transformers (open-source, free)
- Hugging Face Datasets (open-source, free)
Watch first
Then try
In this module
- Hugging Face Transformers for Training
- Hugging Face TRL and PEFT
- Unsloth (and LLaMA-Factory)
- Axolotl
- torchtune