Track 4: Working With LLM APIs, Open and Local Models

Serve Models at Scale: vLLM (and SGLang, TGI)

Serve an OpenAI-compatible endpoint on a GPU and pick an engine.

Status: Coming soon AdvancedVideo lessonAbout 14 min Free tools
Get notified on YouTube Udemy certificate: coming soon

Course

Open Models in Practice: Hugging Face, Ollama, llama.cpp & vLLM

Udemy: coming soon

Tools

Watch first

Then try

In this module

  1. Open-Weight Models Explained: Llama, Qwen, Gemma, Mistral, DeepSeek
  2. Run AI Locally With Ollama (and LM Studio)
  3. Hugging Face for Beginners: Hub, Pipelines, Inference Providers
  4. llama.cpp, GGUF and How Big a Model You Can Run
  5. Serve Models at Scale: vLLM (and SGLang, TGI)

The course this lesson belongs to