All dashboards

llama.cpp Monitoring

llama.cpp LLM server metrics

llama.cpp Monitoring screenshot 1
llama.cpp Monitoring screenshot 2

Displays llama.cpp server metrics collected whilst performing LLM inference.

Source can be found here.

Revisions
RevisionDescriptionCreated

Get this dashboard

Import the dashboard template

or

Download JSON

Datasource
Dependencies
Resources
Docs: Importing dashboards Webinar: Getting started with Grafana dashboard design Webinar: Building advanced Grafana dashboards