Track 10: Training LLMs, Evaluate, Compress and Ship

Merge, Export, Run Your Model (and Model Merging)

Run your fine-tune in Ollama behind an API.

Status: Coming soon IntermediateVideo lessonAbout 18 min Free tools

Part of Train and Fine-Tune Models (42 of 45)

Get notified on YouTube Udemy certificate: coming soon

Course

Fine-Tune Your Own LLM (Free GPU, Step by Step)

Udemy: coming soon

Tools

Watch first

Then try

In this module

  1. Benchmarks Explained, and lm-evaluation-harness
  2. Evaluate Your Fine-Tune Properly
  3. Quantization: GGUF, GPTQ, AWQ, bitsandbytes
  4. Merge, Export, Run Your Model (and Model Merging)
  5. Distillation: Teach a Small Model From a Big One
  6. Capstone: Fine-Tune for a Real Work Task
  7. Model Merging With mergekit: SLERP, TIES, DARE

The course this lesson belongs to