KServe Torchserve Latency
KServe Torchserve Latency Dashobard
<p>Latency metrics for pre/post-process, predict, and explain steps for Torchserve Inference Service with KServe & total number of requests.
Requires inferenceservices to use KServe >= v0.10. See <a href="https://kserve.github.io/website/master/modelserving/observability/prometheus_metrics/" target="_blank" rel="noopener noreferrer">KServe observability docs</a> for more info.</p>
Data source config
Collector type:
Collector plugins:
Collector config:
Revisions
Upload an updated version of an exported dashboard.json file from Grafana
| Revision | Description | Created | |
|---|---|---|---|
| Download |