Track 9: LLM Engineering and Production, Testing and Evals

DeepEval Tutorial

Run LLM tests with pytest.

Status: Coming soon Enroll on Udemy IntermediateVideo lessonAbout 13 min Free tools

Part of Get an AI Engineering Job (70 of 83) and Build AI Agents and Apps (80 of 88)

Get notified on YouTube Enroll on Udemy

Course

Testing AI Agents with Python (DeepEval)

Udemy: Enroll on Udemy

Tools

Watch first

Then try

In this module

  1. Why Evals Are the Unit Tests of AI
  2. Build an Eval Dataset (and Compare Prompts With promptfoo)
  3. LLM-as-Judge, Done Right
  4. DeepEval Tutorial
  5. Regression Gates in CI
  6. Evaluating Agents End to End

Get the certificate course