Track 5: RAG: Retrieval-Augmented Generation, RAG Evaluation

RAGAS Tutorial, With a Synthetic Test Set

Build a test set and score a RAG app.

Status: Coming soon IntermediateVideo lessonAbout 13 min Free tools
Get notified on YouTube Udemy certificate: coming soon

Course

Agent Testing & Evaluation v2 (update of the live DeepEval course)

Udemy: coming soon

Tools

  • RAGAS (open-source, free)

Watch first

Then try

In this module

  1. Why RAG Needs Evaluation
  2. RAG Metrics: Faithfulness, Relevance, Recall@k
  3. RAGAS Tutorial, With a Synthetic Test Set
  4. Evaluate RAG With DeepEval
  5. Evaluate and Ship Your LlamaIndex Assistant
  6. Component RAG Evals: Retriever, Reranker, Generator

The course this lesson belongs to