Menu

Important: This documentation is about an older version. It's relevant only to the release noted, many of the features and functions have been updated or replaced. Please view the current version.

Documentationbreadcrumb arrow Grafana Mimirbreadcrumb arrow Configurebreadcrumb arrow Native histograms
Open source

Configure native histograms

Prometheus native histograms ingestion is an experimental feature of Grafana Mimir.

You can configure native histograms ingestion via the Prometheus remote write API endpoint globally or per tenant.

Note

To enable support for querying native histograms together with Grafana Mimir query sharding, make sure that the flag -query-frontend.query-result-response-format is set to its default protobuf value on query frontends.

Configure native histograms globally

To enable ingesting Prometheus native histograms over the remote write API endpoint for all tenants, set the flag -ingester.native-histograms-ingestion-enabled=true on ingesters.

To limit the number of native histogram buckets per sample, set the -validation.max-native-histogram-buckets flag on distributors. The recommended value is 160 which is the default in the OpenTelemetry SDK for exponential histograms, which are a similar concept in OpenTelemetry. At the time of ingestion, samples with more buckets than the limit will be scaled down, meaning that the resolution will be reduced and buckets will be merged until either the number of buckets is under the limit or the minimal resolution is reached. The behavior can be changed to dropping such samples by setting the ``-validation.reduce-native-histogram-over-max-bucketsoption tofalse`.

Configure native histograms per tenant

To enable ingesting Prometheus native histograms over the remote write API for a tenant, set the native_histograms_ingestion_enabled runtime value to true.

To limit the number of native histogram buckets per sample for a tenant, set the max_native_histogram_buckets runtime value. The recommended value is 160 which is the default in the OpenTelemetry SDK for exponential histograms, which are a similar concept in OpenTelemetry. At the time of ingestion, samples with more buckets than the limit will be scaled down, meaning that the resolution will be reduced and buckets will be merged until either the number of buckets is under the limit or the minimal resolution is reached. The behavior can be changed to dropping such samples by setting the ``-validation.reduce-native-histogram-over-max-bucketsoption tofalse`.

yaml 
overrides:
  tenant1:
    native_histograms_ingestion_enabled: true
    max_native_histogram_buckets: 160

To learn more about sending native histograms to Mimir or Grafana Cloud Metrics via Grafana Agent or Prometheus, see Scrape and send native histograms with Grafana Agent or Scrape and send native histograms with Prometheus.