Text Generation Inference
These metrics are exposed by containers run using Hugging Face’s Text Generation Inference toolkit project (https://github.com/huggingface/text-generation-inference). The second version is a simple dashboard displaying all available metrics, and the third version is an improved version based on the dashboard here: https://github.com/huggingface/text-generation-inference/discussions/1127#discussioncomment-7854661
These metrics are exposed by containers run using Hugging Face’s Text Generation Inference toolkit project (https://github.com/huggingface/text-generation-inference).
The second version is a simple dashboard displaying all available metrics, and the third version onwards is an improved version based on the dashboard here: https://github.com/huggingface/text-generation-inference/discussions/1127#discussioncomment-7854661
Data source config
Collector config:
Dashboard revisions
Upload an updated version of an exported dashboard.json file from Grafana
| Revision | Decscription | Created | |
|---|---|---|---|
| Download |
Get this dashboard
Data source:
Dependencies: