Track 10: Training LLMs, Training Data

Deduplication and Decontamination

Keep test data out of training data.

Status: Coming soon AdvancedVideo lessonAbout 12 min Free tools

Part of Train and Fine-Tune Models (25 of 45)

Get notified on YouTube

Course

Part of the free syllabus, not yet in a certificate course.

Udemy: coming soon

Tools

Watch first

In this module

  1. Chat and Instruction Data Formats
  2. Build a 300-1,000 Example Dataset: Clean, Split, Licence-Check
  3. Synthetic Data With Guardrails
  4. Deduplication and Decontamination