Track 9: LLM Engineering and Production, Observability
Langfuse and LangSmith Tutorial
Trace, score and debug an app in Langfuse or LangSmith.
Get notified on YouTube Udemy certificate: coming soon
Course
Agent Observability & Cost Control
Udemy: coming soon
Tools
- Langfuse (open-source, freemium)
Watch first
Then try
- Dashboards and Alerts for AI Apps
- Capstone: Ship a Production AI Service
- Online Evals and A/B Tests on Live Traffic
- Langfuse Evals: Datasets, Experiments, LLM Judges
In this module
- Why AI Apps Need Observability
- Tracing LLM Apps With OpenTelemetry
- Langfuse and LangSmith Tutorial
- Dashboards and Alerts for AI Apps
The course this lesson belongs to