Celery Metrics

Dashboard

Monitoring Celery task and worker events with metrics, and recording tasks information, saved with Prometheus
Last updated: 4 months ago

Downloads: 23

Reviews: 0

  • grafana_celery.gif
    grafana_celery.gif

The metrics were designed as following:

TypeNameWorkerTaskResults
Gaugeworkers_state
Counterworkers_processed
Gaugeworkers_active
Countertasks_counter
Summarytasks_runtime
Infotasks_info

The main idea is all about Prometheus with its pushgateway and its python client. You could find more information in below.
Main project provides simple python scripts for crawling website with celery, the monitor part is defined in monitor.py;
Others like pushgateway and python client should be appreciated.