Example of alerting on tabular data
Grafana Cloud Enterprise Open source

Example of alerting on tabular data

Not all data sources return time series data. SQL databases, CSV files, and some APIs often return results as rows or arrays of columns or fields — commonly referred to as tabular data.

This example shows how to create an alert rule using data in table format. Grafana treats each row as a separate alert instance, as long as the data meets the expected format.

How Grafana Alerting evaluates tabular data

When a query returns data in table format, Grafana transforms each row into a separate alert instance.

To evaluate each row (alert instance), it expects:

  1. Only one numeric column. This is the value used for evaluating the alert condition.
  2. Non-numeric columns. These columns defines the label set. The column name becomes a label name; and the cell value becomes the label value.
  3. Unique label sets per row. Each row must be uniquely identifiable by its labels. This ensures each row represents a distinct alert instance.

Caution

These three conditions must be met—otherwise, Grafana can’t evaluate the table data and the rule will fail.

Example overview

Imagine you store disk usage in a DiskSpace table and you want to trigger alerts when the available space drops below 5%.

TimeHostDiskPercentFree
2021-06-07web1/etc3
2021-06-07web2/var4
2021-06-07web3/var8

To calculate the free space per Host and Disk in this case, you can use $__timeFilter to filter by time but without returning the date to Grafana:

sql
SELECT
  Host,
  Disk,
  AVG(PercentFree) AS PercentFree
FROM DiskSpace
WHERE $__timeFilter(Time)
GROUP BY Host, Disk

This query returns the following table response:

HostDiskPercentFree
web1/etc3
web2/var4
web3/var8

When Alerting evaluates the query response, the data is transformed into three alert instances as previously detailed:

  • The numeric column becomes the value for the alert condition.
  • Additional columns define the label set for each alert instance.
Alert instanceValue
{Host="web1", Disk="/etc"}3
{Host="web2", Disk="/var"}4
{Host="web3", Disk="/var"}8

Finally, an alert condition that checks for less than 5% of free space ($A < 5) would result in two alert instances firing:

Alert instanceValueState
{Host="web1", Disk="/etc"}3Firing
{Host="web2", Disk="/var"}4Firing
{Host="web3", Disk="/var"}8Normal

Try it with TestData

To test this quickly, you can simulate the table using the TestData data source:

  1. Add the TestData data source through the Connections menu.

  2. Go to Alerting and create an alert rule

  3. Select TestData as the data source.

  4. From Scenario, select CSV Content and paste this CSV:

    bash
    host, disk, percentFree
    web1, /etc, 3
    web2, /var, 4
    web3, /var, 8
  5. Set a condition like $A < 5 and Preview the alert.

    Grafana evaluates the table data and fires the two first alert instances.

    Alert preview with tabular data using the TestData data source

Differences with time series data

Working with time series is similar—each series is treated as a separate alert instance, based on its label set.

The key difference is the data format:

  • Time series data contains multiple values over time, each with its own timestamp. To evaluate the alert condition, alert rules must reduce each series to a single number using a function like last(), avg(), or max().
  • Tabular data doesn’t require reduction, as each row contains only a single numeric value used to evaluate the alert condition.

For comparison, see the multi-dimensional time series data example.