Track 11: ML and Deep Learning Foundations for AI Engineers
Transformers & GPT From Scratch for AI Engineers
24 lessons
Track 11: ML and Deep Learning Foundations for AI Engineers, Maths Intuition
Optimisers: SGD, Adam, Learning-Rate Schedules
Tune a learning rate from a loss curve.
Part of Train and Fine-Tune Models (4 of 45)
Get notified on YouTube Udemy certificate: coming soon
Course
Transformers & GPT From Scratch for AI Engineers
Udemy: coming soon
Tools
- PyTorch (open-source, free)
Watch first
In this module
- Vectors, Similarity and Probability, Visually
- Matrices: What a Layer Really Does
- Gradients, Loss Functions and Gradient Descent
- Optimisers: SGD, Adam, Learning-Rate Schedules
The course this lesson belongs to