About Kafka integration pre-built dashboards
The Kafka integration provides a variety of pre-built dashboards that you can use right away to begin troubleshooting issues. In this step of the journey, you’ll become familiar with these pre-built dashboards and learn how to use them to address various problems.
Did you know?
If you don’t see any metrics, try switching the data source using the drop-down at the top of the dashboard.
This dashboard offers a comprehensive overview of your Kafka cluster, including:
- Active Kafka controllers: Displays the number of active controllers in the cluster.
- Broker count: Shows the total number of brokers in the cluster.
- Partition health: Displays unclean leader elections, preferred replica imbalances, and partition distribution.
- Cluster throughput: Shows cluster-wide network throughput for bytes in and messages in.
- Current role: Visualizes the distribution of partition leadership across brokers.
- Broker throughput: Displays network throughput and message rates per broker.
- Replication status: Shows online partitions, offline partitions, under-replicated partitions, and under min ISR partitions.
- Process overview: Displays process uptime, start times, and load average.
- JVM overview: Shows CPU usage and memory usage for Kafka broker JVM processes.
Use this dashboard to:
- Gain a high-level understanding of the operational status of your Kafka cluster.
- Quickly identify broker health issues and partition distribution problems.
- Monitor cluster-wide throughput and performance trends.
This dashboard shows detailed information about Kafka topics, including:
- Topic overview: Displays a table with namespace, partition, topic, start offset, end offset, messages per second, and topic log size.
- Messages per second: Shows the message ingestion rate for each topic over time.
- Topic bytes in/out: Displays the data transfer rates for topics.
- Consumer group overview: Shows consumer groups, their associated topics, consume rate, and lag.
- Consumer group metrics: Displays consume rate and consumer lag over time for each consumer group.
Use this dashboard to:
- Monitor topic-level performance and message throughput.
- Identify topics with high or unusual message rates.
- Track consumer lag to ensure timely message processing.
- Analyze topic growth and storage utilization.
This dashboard displays information about Kafka Connect, including:
- General: Shows tasks total, tasks running, tasks paused, tasks failed, tasks unassigned, and tasks destroyed.
- Connector status: Displays the repartition of connectors and tasks per status.
- Status of connectors and tasks: Shows time-series graphs of connector and task status over time.
- System: Displays CPU usage and JVM memory used for Connect workers.
- Connect Worker: Shows a table with cluster, instance, startup time, version, connector count, and task details.
Use this dashboard to:
- Monitor the health and status of your Kafka Connect deployment.
- Track connector and task execution status.
- Identify failed or struggling connectors that need attention.
- Monitor resource usage of Connect workers.
In the next milestone, you learn about the pre-built alerts included with the Kafka integration.
At this point in your journey, you can explore the following paths: