Agent Observability
Note
Grafana Agent Observability is currently in public preview. Grafana Labs offers limited support, and breaking changes might occur prior to the feature being made generally available.
Overview
Agent Observability is built on OpenTelemetry and gives teams running LLM agents in production a single place to monitor agent activity, trace conversations, track costs, and evaluate quality.
Agent Observability provides thin SDKs for Go, Python, TypeScript, Java, and .NET that capture generation data with minimal code changes. Built-in framework integrations for LangChain, LangGraph, OpenAI Agents, Vercel AI SDK, and others make instrumentation automatic.
With Agent Observability in Grafana Cloud, you can browse conversations, drill into traces, compare agent versions, configure online evaluation rules and guards, review offline experiment reports, and use built-in analytics for metrics, logs, traces, and profiles.
Use Agent Observability
Use Agent Observability to understand agent behavior from development through production. You can:
- Capture LLM generations, tool calls, workflow steps, token usage, and cost data from your agents.
- Forward coding-agent sessions from supported tools without adding SDK code to an application.
- Search and inspect conversations, then connect individual generations to OpenTelemetry traces and metrics.
- Track agent versions, prompt changes, tool usage, quality scores, latency, errors, and cost trends.
- Configure online evaluations and guards to score or gate production traffic.
- Run offline experiments in public preview to compare models, prompts, and agent versions before release.
