KServe Torchserve Latency
KServe Torchserve Latency Dashobard
Latency metrics for pre/post-process, predict, and explain steps for Torchserve Inference Service with KServe & total number of requests. Requires inferenceservices to use KServe >= v0.10. See KServe observability docs for more info.
Data source config
Collector type:
Collector plugins:
Collector config:
Dashboard revisions
Upload an updated version of an exported dashboard.json file from Grafana
| Revision | Decscription | Created | |
|---|---|---|---|
| Download |
Sign up for Grafana Cloud
Get up and running in minutes with the Grafana Cloud free tier, which includes free forever 10k metrics, 50GB logs, 50GB traces, 500 VUh, and more.
Get this dashboard
Data source:
Dependencies: