DocumentationGrafana CloudMonitor infrastructureKubernetes MonitoringRespond to alerts

Respond to alerts

Respond to and troubleshoot alerts about your infrastructure and the applications running within it without leaving the context of Grafana Kubernetes Monitoring.

Start from snapshot on home page

Within the section Pods in trouble [15m] on the home page, alert-related columns provide the severity of each alert (Critical, Warning, Info) and the name of the alert. You can click directly into the Pod, namespace, or Cluster to continue your troubleshooting and problem solving.

Start from Alerts page

The Alerts page in Kubernetes Monitoring displays all alerts related solely to your Kubernetes infrastructure and any applications within your infrastructure. The graphs at the top of the page show the alerts by Cluster and namespace, as well as the alert severity rating.

Use filtering to look at one Cluster or namespace, or a severity rating.

The list of Firing Alerts reflects the filters at the top of the page. Additionally, you can filter further within the list to isolate a Cluster, namespace, workload, Pod, or container.

With one click, you can open the alert rule itself, or the details page for the Cluster, namespace, workload, Pod, or container.

Use the runbooks

From the Alerts page, click the alert name to navigate to the runbook for more information.

1. Click the name of the alert to open the Alert rules page for that alert.
2. Expand the Firing state.
3. Click View runbook to open to the alert in the kubernetes-mixin.
4. Click Link to view the specific runbook at kube-prometheus runbooks.

Manage alerts

Preconfigured alerting rules are available out of the box.

There are two ways to open an alert rule to open the Alert page in a new browser tab:

• In the Alerts page in the list of Firing Alerts, click the name of the alert.

• In a Cluster, namespace, Node, Pod, or container list, click the underlined number next to the list item.

For details on alert rules, refer to Configure alerting.

You can silence some default alerts temporarily as a useful strategy when you are investigating alerts.

Copy an alert

While you cannot alter the alerts that are available in Kubernetes Monitoring, you can copy them and customize them. This can be helpful when troubleshooting. For example, you may want to know whether an existing state that’s causing an alert to fire is temporary or a longer term problem. To copy an alert:

1. Click the name of the alert on the Alerts page to open the alert rule in a new tab .
2. On the Alert rules, expand the Firing section.
3. Under Actions, click More, and select Duplicate.

4. On the New alert rule page, follow the steps to create and configure the rule.