Apache Spark - Performance Metrics

Dashboard

Monitors spark metrics using Prometheus in Kubernetes
Last updated: a month ago

Downloads: 96

  • Capture.PNG
    Capture.PNG

Spark Metrics Dashboard :- Having Spark Driver / Executor Memory Consumption and other related metrics in Kubernetes using JMX Exporter and Prometheus Service Discovery Including Network I/O and Disk Read/Write Metrics for Spark Driver , Executors and Shuffle Service

Add Labels to Spark Driver and Executor accordingly for Prometheus to fetch metrics through service discovery