Apache Spark - Performance Metrics


Monitors spark metrics using Prometheus in Kubernetes
Last updated: 9 months ago

Downloads: 573

Reviews: 0

  • Capture.PNG

Spark Metrics Dashboard :- Having Spark Driver / Executor Memory Consumption and other related metrics in Kubernetes using JMX Exporter and Prometheus Service Discovery Including Network I/O and Disk Read/Write Metrics for Spark Driver , Executors and Shuffle Service

Add Labels to Spark Driver and Executor accordingly for Prometheus to fetch metrics through service discovery