Track 10: Training LLMs, Training Data
Build a 300-1,000 Example Dataset: Clean, Split, Licence-Check
Collect, clean and split a dataset without leakage.
Part of Train and Fine-Tune Models (23 of 45)
Get notified on YouTube Udemy certificate: coming soon
Course
Fine-Tune Your Own LLM (Free GPU, Step by Step)
Udemy: coming soon
Tools
- Hugging Face Datasets (open-source, free)
- pandas (open-source, free)
Watch first
Then try
- Synthetic Data With Guardrails
- Deduplication and Decontamination
- Your First Fine-Tune on Colab (Instruction Tuning)
In this module
- Chat and Instruction Data Formats
- Build a 300-1,000 Example Dataset: Clean, Split, Licence-Check
- Synthetic Data With Guardrails
- Deduplication and Decontamination
The course this lesson belongs to