GrafanaでApache Sparkを簡単に監視
Grafana Cloudのすぐに使える監視ソリューションを使用して、大規模データ処理のための統合分析エンジンであるApache Sparkを簡単に監視できます。Grafana Cloudの永久無料枠には、監視ニーズをサポートするために3ユーザーと最大10,000メトリクスシリーズが含まれています。
主要なアラートルールを含みます。
metrics_master_workers_Number
metrics_spark_app_driver_BlockManager_disk_diskSpaceUsed_MB_Number
metrics_spark_app_driver_BlockManager_memory_maxMem_MB_Number
metrics_spark_app_driver_BlockManager_memory_maxOffHeapMem_MB_Number
metrics_spark_app_driver_BlockManager_memory_maxOnHeapMem_MB_Number
metrics_spark_app_driver_DAGScheduler_job_activeJobs_Number
metrics_spark_app_driver_DAGScheduler_job_allJobs_Number
metrics_spark_app_driver_DAGScheduler_messageProcessingTime_Max
metrics_spark_app_driver_DAGScheduler_messageProcessingTime_Mean
metrics_spark_app_driver_DAGScheduler_messageProcessingTime_Min
metrics_spark_app_driver_DAGScheduler_messageProcessingTime_StdDev
metrics_spark_app_driver_DAGScheduler_stage_failedStages_Number
metrics_spark_app_driver_DAGScheduler_stage_runningStages_Number
metrics_spark_app_driver_DAGScheduler_stage_waitingStages_Number
metrics_spark_app_driver_LiveListenerBus_listenerProcessingTime_org_apache_spark_HeartbeatReceiver_Count
metrics_spark_app_driver_LiveListenerBus_listenerProcessingTime_org_apache_spark_HeartbeatReceiver_Max
metrics_spark_app_driver_LiveListenerBus_listenerProcessingTime_org_apache_spark_HeartbeatReceiver_Mean
metrics_spark_app_driver_LiveListenerBus_listenerProcessingTime_org_apache_spark_HeartbeatReceiver_Min
metrics_worker_coresFree_Number
metrics_worker_coresUsed_Number
metrics_worker_memFree_MB_Number
metrics_worker_memUsed_MB_Number