Codex

Monitoring dashboard for OpenAI Codex CLI usage. Tracks sessions, conversation turns, token consumption (including reasoning tokens and prompt cache hits), tool call reliability and latency, turn latency percentiles, time-to-first-token, sandbox policy distribution, and approval outcomes. Data sourced from Application Insights via OpenTelemetry.

Codex screenshot 1

Codex CLI Monitoring Dashboard

Monitor OpenAI Codex CLI usage and performance using Application Insights and OpenTelemetry data.

What This Dashboard Shows

  • Summary KPIs: Sessions (threads), conversation turns, total token consumption
  • Token Analytics: Reasoning tokens, prompt cache hits, input/output breakdown
  • Tool Calls: Reliability, latency, and usage patterns across tools
  • Latency Metrics: Turn latency percentiles, time-to-first-token
  • Sandbox & Approvals: Sandbox policy distribution and approval outcomes
  • Error Tracking: Exception monitoring and debugging

Prerequisites

  • Azure Managed Grafana instance
  • Application Insights resource with OpenTelemetry data from Codex CLI
  • Azure Monitor data source configured in Grafana

Getting Started

  1. Import this dashboard into your Azure Managed Grafana instance
  2. Select your Azure Monitor data source
  3. Configure the Application Insights resource filter

For detailed setup instructions, visit: https://aka.ms/amg/dash-doc/codex

Revisions
RevisionDescriptionCreated

Get this dashboard

Import the dashboard template

or

Download JSON

Datasource
Dependencies