Track 4: Working With LLM APIs
Open Models in Practice: Hugging Face, Ollama, llama.cpp & vLLM
9 lessons
Track 15: Frontier and Advanced, Reasoning Models and Inference
Project: Benchmark Your Model Serving Stack
Compare two serving setups on your own GPU budget (verify price).
Get notified on YouTube Udemy certificate: coming soon
Course
Open Models in Practice: Hugging Face, Ollama, llama.cpp & vLLM
Udemy: coming soon
Tools
- vLLM (open-source, free)
- SGLang (open-source, free)
- GPU clouds (RunPod, Lambda, Vast.ai, E2E Networks) (paid)
Watch first
In this module
- Reasoning Models in Production: When They Pay Off
- Thinking Budgets: Cost, Latency and Quality
- Long Context vs RAG: Measure Cost and Accuracy
- Small and On-Device Models: Laptops, Phones and Browsers
- Inference Optimisation: KV Cache and Prefix Caching
- Speculative Decoding and Continuous Batching
- Project: Benchmark Your Model Serving Stack
The course this lesson belongs to