Visualization and monitoring solutions
Visualization and monitoring solutions  /  Monitor TensorFlow Serving
TensorFlow Serving logo

Monitor TensorFlow Serving easily with Grafana

Easily monitor TensorFlow Serving, an open source platform for machine learning, with Grafana Cloud’s out-of-the-box monitoring solution. The Grafana Cloud forever-free tier includes 3 users and up to 10k metrics series to support your monitoring needs.

TensorFlow server monitoring dashboard (2/3) example TensorFlow server monitoring dashboard (3/3) example TensorFlow server monitoring dashboard (1/3) example
TensorFlow server monitoring dashboard (2/3) example
TensorFlow server monitoring dashboard (3/3) example

Key metrics included

:tensorflow:core:graph_build_calls
:tensorflow:core:graph_build_time_usecs
:tensorflow:core:graph_run_time_usecs
:tensorflow:core:graph_runs
:tensorflow:serving:batching_session:queuing_latency_count
:tensorflow:serving:batching_session:queuing_latency_sum
:tensorflow:serving:request_count
:tensorflow:serving:request_latency_count
:tensorflow:serving:request_latency_sum
:tensorflow:serving:runtime_latency_count
:tensorflow:serving:runtime_latency_sum

Key alerting rules included

TensorFlowModelRequestHighErrorRate
TensorFlowServingHighBatchQueuingLatency