KServe Torchserve Latency
KServe Torchserve Latency Dashobard
Latency metrics for pre/post-process, predict, and explain steps for Torchserve Inference Service with KServe & total number of requests. Requires inferenceservices to use KServe >= v0.10. See KServe observability docs for more info.
Dashboard revisions
Upload an updated version of an exported dashboard.json file from Grafana
| Revision | Decscription | Created | |
|---|---|---|---|
| Download |
Get this dashboard
Data source:
Dependencies: