Documentationbreadcrumb arrow Grafana Cloudbreadcrumb arrow AI and machine learningbreadcrumb arrow Grafana AI Observabilitybreadcrumb arrow Configurebreadcrumb arrow Tune plugin settings
Grafana Cloud

Configure the AI Observability plugin

The Grafana AI Observability plugin provides the UI for browsing conversations, managing agents, configuring evaluation, and viewing dashboards. This article covers plugin configuration and access control.

Plugin roles

AI Observability defines five plugin roles that control access to features:

RolePermissions
Sigil ViewerLanding page and tutorial.
Sigil Data ReaderRead access to dashboards, traces, model cards, and evaluation pages without conversation access.
Sigil ReaderDashboards, conversations, traces, model cards, and evaluation results.
Sigil Feedback WriterWrite conversation feedback (ratings and annotations).
Sigil AdminFull access including feedback, evaluation configuration, alert rules, and data source settings.

Assign roles

Assign AI Observability roles to Grafana roles or teams using RBAC:

  1. Navigate to Administration > Users and access > Roles.
  2. Find or create the role you want to assign AI Observability permissions to.
  3. Add the appropriate grafana-sigil-app.* permissions.

Connect data sources

The AI Observability plugin queries Prometheus (metrics), Tempo (traces), and the AI Observability API (generations). In Configuration, set:

  • The AI Observability API endpoint.
  • The Prometheus data source for metrics dashboards.
  • The Tempo data source for trace drilldown.

For Grafana Cloud deployments, data sources are configured automatically.

Plugin pages

PagePathDescription
Analytics/a/grafana-sigil-app/analyticsActivity, latency, error, token, and cost dashboards.
Conversations/a/grafana-sigil-app/conversationsBrowse and search conversations.
Tools/a/grafana-sigil-app/analytics/toolsTool usage analytics.
Agents/a/grafana-sigil-app/agentsAgent catalog with version history.
Evaluation/a/grafana-sigil-app/evaluationEvaluation rules, evaluators, and scores.
Setup/a/grafana-sigil-app/setupOnboarding wizard and demo data seeding.
Configuration/plugins/grafana-sigil-appPlugin settings (Admin only).

Command palette

AI Observability registers its pages in the Grafana command palette. Press Cmd+K (Mac) or Ctrl+K (Linux/Windows) and type “AI Observability” to quickly navigate to any AI Observability page.

Next steps