Track 9: LLM Engineering and Production, Observability
Dashboards and Alerts for AI Apps
Alert on cost, latency and quality drift.
Get notified on YouTube Udemy certificate: coming soon
Course
Agent Observability & Cost Control
Udemy: coming soon
Tools
- Langfuse (open-source, freemium)
- OpenTelemetry (GenAI conventions) (open-source, free)
Watch first
In this module
- Why AI Apps Need Observability
- Tracing LLM Apps With OpenTelemetry
- Langfuse and LangSmith Tutorial
- Dashboards and Alerts for AI Apps