
ASAPQuery: Speed up Grafana dashboards by 100x
- Tuesday, 21 April
- 17:30
- 10 minutes
- Main
- Session
Get notified when on-demand recordings are ready
Refresh latencies of Grafana dashboards are dependent on how quickly the underlying system (like Prometheus or Clickhouse) can answer queries. Naturally, as these systems ingest and query more data, dashboard refreshes become slower. While one could scale out the underlying systems to speed up queries, this increases the Total Cost of Ownership (TCO).
In this lightning talk, Milind Srivastava, a PhD student at Carnegie Mellon University, proposes a new way to compute observability queries that doesn't force you to choose between low TCO and low latency. Instead of traditional queries that are executed on raw data, queries can be executed on "semantic-preserving summaries" that use orders of magnitude lower memory and CPU resources, compared to executing on raw data. Milind is releasing an open source system that speeds up Grafana query latencies by 100x using this method. See a live demo of ASAPQuery, which is built to be backwards-compatible with an existing observability deployment and can be deployed in a drop-in manner between Grafana and the underlying system (like Prometheus or Clickhouse).
Speakers

Milind Srivastava
PhD student — Carnegie Mellon University