KServe Torchserve Latency

KServe Torchserve Latency Dashobard

Latency metrics for pre/post-process, predict, and explain steps for Torchserve Inference Service with KServe & total number of requests. Requires inferenceservices to use KServe >= v0.10. See KServe observability docs for more info.

Revisions
RevisionDescriptionCreated

Get this dashboard

Import the dashboard template

or

Download JSON

Datasource
Dependencies