Celery Metrics

Dashboard

Monitoring Celery task and worker events with metrics, and recording tasks information, saved with Prometheus
Last updated: 2 years ago

Start with Grafana Cloud and the new FREE tier. Includes 10K series Prometheus or Graphite Metrics and 50gb Loki Logs

Downloads: 349

Reviews: 0

  • grafana_celery.gif
    grafana_celery.gif

The metrics were designed as following:

TypeNameWorkerTaskResults
Gaugeworkers_state
Counterworkers_processed
Gaugeworkers_active
Countertasks_counter
Summarytasks_runtime
Infotasks_info

The main idea is all about Prometheus with its pushgateway and its python client. You could find more information in below.
Main project provides simple python scripts for crawling website with celery, the monitor part is defined in monitor.py;
Others like pushgateway and python client should be appreciated.