LiteLLM

LiteLLM Prometheus Metrics

LiteLLM screenshot 1
LiteLLM screenshot 2
LiteLLM screenshot 3

Enable Metrics in config.yaml

litellm_settings:
  callbacks:
    - prometheus

Add prometheus job

  - job_name: 'litellm'
    metrics_path: "/metrics/"
    static_configs:
      - targets: ['127.0.0.1:4000']
Revisions
RevisionDescriptionCreated

Get this dashboard

Import the dashboard template

or

Download JSON

Datasource
Dependencies