Track 4: Working With LLM APIs, Open and Local Models

llama.cpp, GGUF and How Big a Model You Can Run

Run a quantized model on CPU and size models to your hardware.

Status: Coming soon IntermediateVideo lessonAbout 13 min Free tools
Get notified on YouTube Udemy certificate: coming soon

Course

Open Models in Practice: Hugging Face, Ollama, llama.cpp & vLLM

Udemy: coming soon

Tools

Watch first

Then try

In this module

  1. Open-Weight Models Explained: Llama, Qwen, Gemma, Mistral, DeepSeek
  2. Run AI Locally With Ollama (and LM Studio)
  3. Hugging Face for Beginners: Hub, Pipelines, Inference Providers
  4. llama.cpp, GGUF and How Big a Model You Can Run
  5. Serve Models at Scale: vLLM (and SGLang, TGI)

The course this lesson belongs to