Get started with Grafana integrationsCurrently available IntegrationsConfluent Cloud integration

Confluent Cloud integration for Grafana Cloud

The Confluent Cloud integration enables you to quickly pull in Confluent Cloud metrics to Grafana Cloud. The integration provides a number of prebuilt dashboards to help you monitor your Confluent Cloud service. No agent is required, and you can create multiple configurations called scrape jobs to organize your data.

Install Confluent Cloud integration for Grafana Cloud

  1. In your Grafana instance, click Integrations and Connections (lightning bolt icon).

  2. Click the Confluent Cloud tile.

  3. Create a Cloud API key in Confluent Cloud. You can navigate to Confluent to retrieve this information by clicking Open Confluent Cloud.

  4. Enter a name for this specific connection under Scrape job name.

  5. Copy and paste the API Key from Confluent Cloud into API Key.

  6. Copy and paste the API Secret from Confluent Cloud into API Secret.

  7. Click Test Connection. If you encounter an error, be sure that you’ve entered the right API credentials from your Confluent Cloud account.

Configure resource settings

You must add at least one resource to the Confluent Cloud integration in order to save the scrape job.

  1. Select the desired Confluent Cloud resource under Resource Type.

  2. Copy and paste the associated Confluent Cloud resource ID into Resource ID.

  3. When you’ve added all of the resources you wish to monitor, click Save Scrape Job.

You’ll see a success page and can navigate to the dashboards that have been installed.

Dashboards

After you have successfully configured the Confluent Cloud integration, prebuilt dashboards will be installed in your Grafana instance to help you monitor your Confluent Cloud services.

Managing Your integration

After you’ve successfully configured a scrape job, no other management is needed. Grafana Cloud will manage the scraping of metrics from Confluent Cloud into Grafana Cloud.

You can view, edit, or delete your existing scrape jobs at any time by navigating to back to the integration, via the Integrations and Connections button (lightning bolt icon) on the left hand side and selecting the Confluent Cloud tile.

Resources

The Confluent Cloud integration allows you to pull in metrics from the following Confluent Cloud resources:

  • Kafka Cluster
  • Kafka Connector
  • KsqlDB
  • Schema Registry

Metrics

Below is a list of the metrics per resource that are automatically written to your Grafana Cloud instance when you select a resource to connect to. The metrics will be named using the following naming convention:

Kafka Cluster

Metric Name Labels
confluent_kafka_server_received_bytes topic
confluent_kafka_server_sent_bytes topic
confluent_kafka_server_received_records topic
confluent_kafka_server_sent_records topic
confluent_kafka_server_retained_bytes topic
confluent_kafka_server_request_count type, principal_id
confluent_kafka_server_active_connection_count principal_id
confluent_kafka_server_partition_count
confluent_kafka_server_successful_authentication_count principal_id

Kafka Connector

Metric Name Labels
confluent_kafka_connect_received_bytes
confluent_kafka_connect_sent_bytes
confluent_kafka_connect_received_records
confluent_kafka_connect_sent_records
confluent_kafka_connect_dead_letter_queue_records

KsqlDB

Metric Name Labels
confluent_kafka_ksql_streaming_unit_count

Schema Registry

Metric Name Labels
confluent_kafka_schema_registry_schema_count