How a watcher differs from an alert rule
A Grafana alert rule is a query you write with a fixed condition. A watcher is different: you describe what healthy looks like, and Assistant turns that into checks against your data.
For checkout, an alert rule fires when error rate stays above 5% for the pending period you set, which is how long the condition must be met before the rule starts firing. A watcher can also use context you give it, such as that short spikes during a rollout are expected and that checkout should recover within a few minutes.
An alert rule’s destination is a contact point, for example an email address or a Slack channel. The routing rules that decide which alert reaches which contact point are notification policies.
How they work together
A watcher can send its findings to Grafana Alerting. Your notification policies and contact points then control delivery, the same way they do for alert rules.
To decide for a specific service, use Assistant’s Alerts & Watchers mode. Describe the service or scope you want to review, and Assistant recommends alerts, watchers, both, or no notification based on your telemetry and needs.
The hands-on path creates a watcher and leaves its notification and investigation actions off.