Enable alerting high availability
You can enable alerting high availability support by updating the Grafana configuration file. On Kubernetes, you can enable alerting high availability by updating the Kubernetes container definition.
Update Grafana configuration file
Before you begin
Since gossiping of notifications and silences uses both TCP and UDP port
9094, ensure that each Grafana instance is able to accept incoming connections on these ports.
To enable high availability support:
- In your custom configuration file ($WORKING_DIR/conf/custom.ini), go to the
[ha_peers]to the number of hosts for each Grafana instance in the cluster (using a format of host:port), for example,
ha_peers=10.0.0.5:9094,10.0.0.6:9094,10.0.0.7:9094. You must have at least one (1) Grafana instance added to the [
[ha_listen_address]to the instance IP address using a format of
host:port(or the Pod’s IP in the case of using Kubernetes). By default, it is set to listen to all interfaces (
Update Kubernetes container definition
If you are using Kubernetes, you can expose the pod IP through an environment variable via the container definition such as:
env: - name: POD_IP valueFrom: fieldRef: fieldPath: status.podIP
Related Grafana Cloud resources
How to set up and visualize synthetic monitoring at scale with Grafana Cloud
Learn how to use Kubernetes, Grafana Loki, and Grafana Cloud’s synthetic monitoring feature to set up your infrastructure's checks in this GrafanaCONline session.
Using Grafana Cloud to drive manufacturing plant efficiency
This GrafanaCONline session tells how Grafana helps a 75-year-old manufacturing company with product quality and equipment maintenance.