Track 15: Frontier and Advanced, Reasoning Models and Inference

Reasoning Models in Production: When They Pay Off

Decide per task whether a reasoning model is worth it.

Status: Coming soon BeginnerVideo lessonAbout 11 min
Get notified on YouTube Udemy certificate: coming soon

Course

LLM APIs Masterclass: OpenAI, Claude, Gemini & Local Models

Udemy: coming soon

Watch first

Then try

In this module

  1. Reasoning Models in Production: When They Pay Off
  2. Thinking Budgets: Cost, Latency and Quality
  3. Long Context vs RAG: Measure Cost and Accuracy
  4. Small and On-Device Models: Laptops, Phones and Browsers
  5. Inference Optimisation: KV Cache and Prefix Caching
  6. Speculative Decoding and Continuous Batching
  7. Project: Benchmark Your Model Serving Stack

The course this lesson belongs to