Track 10: Training LLMs, Evaluate, Compress and Ship

Capstone: Fine-Tune for a Real Work Task

Deliver a model, eval report and demo.

Status: Coming soon AdvancedProjectAbout 15 min Free tools

Part of Train and Fine-Tune Models (44 of 45)

Get notified on YouTube Udemy certificate: coming soon

Course

Fine-Tune Your Own LLM (Free GPU, Step by Step)

Udemy: coming soon

Tools

Watch first

In this module

  1. Benchmarks Explained, and lm-evaluation-harness
  2. Evaluate Your Fine-Tune Properly
  3. Quantization: GGUF, GPTQ, AWQ, bitsandbytes
  4. Merge, Export, Run Your Model (and Model Merging)
  5. Distillation: Teach a Small Model From a Big One
  6. Capstone: Fine-Tune for a Real Work Task
  7. Model Merging With mergekit: SLERP, TIES, DARE

The course this lesson belongs to