Menu
Grafana Agent Flow mode Tasks Distribute Prometheus metrics scrape load
Open source

Distribute Prometheus metrics scrape load

A good predictor for the size of an Grafana Agent Flow deployment is the number of Prometheus targets each Grafana Agent scrapes. Clustering with target auto-distribution allows a fleet of Grafana Agents to work together to dynamically distribute their scrape load, providing high-availability.

Note: Clustering is a beta feature. Beta features are subject to breaking changes and may be replaced with equivalent functionality that covers the same use case.

Before you begin

Steps

To distribute Prometheus metrics scrape load with clustering:

  1. Add the following block to all prometheus.scrape components, which should use auto-distribution:

    river
    clustering {
      enabled = true
    }
  2. Restart or reload Grafana Agents for them to use the new configuration.

  3. Validate that auto-distribution is functioning:

    1. Using the Grafana Agent UI on each Grafana Agent, navigate to the details page for one of the prometheus.scrape components you modified.

    2. Compare the Debug Info sections between two different Grafana Agent to ensure that they’re not scraping the same sets of targets.