Grafana Cloud

How notifications work in the knowledge graph

This topic describes what happens when you create a notification in the knowledge graph.

Intention

The knowledge graph uses ALERTS to generate insights. In most cases, you don’t want the system to notify you when each insight fires as this can create quite a bit of noise. To reduce noise, create notifications with filters that target only the insights you want to be alerted about.

What happens when you create a notification

When you create a notification, the knowledge graph generates an alerting rule with specific labels that can be consumed by an Alertmanager template. These rules all have the alertname called NOTIFICATION_ALERTS. The following table shows the special labels and values so that you can identify and route the notification to facilitate linking back to RCA workbench:

LabelValueDescription
alertnameNOTIFICATION_ALERTSAll notification alerts have this name.
source_alertname<ORIGINAL ALERTNAME>The original or source alertname label value.
asserts_assertion_nameThe insight name that’s associated with the alert. This value is used to link back to RCA workbench, for example, NETWORK:RX_BYTES::ResourceRateAnomaly.
asserts_notification_rule_name<NOTIFICATION RULE NAME>The name of the notification rule when created in the Grafana Cloud user interface. This can be different from the alertname label if desired.

Next steps

Now that you understand how notifications work in the knowledge graph: