Data configurationGrafana integrationsIntegrations referenceConfluent Cloud integration

Confluent Cloud integration for Grafana Cloud

The Confluent Cloud integration enables you to quickly pull in Confluent Cloud metrics to Grafana Cloud. The integration provides a number of prebuilt dashboards to help you monitor your Confluent Cloud service. No agent is required, and you can create multiple configurations called scrape jobs to organize your data.

Install Confluent Cloud integration for Grafana Cloud

  1. In your Grafana instance, click Integrations and Connections (lightning bolt icon).

  2. Click the Confluent Cloud tile.

  3. Create a Cloud API key in Confluent Cloud. You can navigate to Confluent to retrieve this information by clicking Open Confluent Cloud.

  4. Enter a name for this specific connection under Scrape job name.

  5. Copy and paste the API Key from Confluent Cloud into API Key.

  6. Copy and paste the API Secret from Confluent Cloud into API Secret.

  7. Click Test Connection. If you encounter an error, be sure that you’ve entered the right API credentials from your Confluent Cloud account.

Configure resource settings

You must add at least one resource to the Confluent Cloud integration in order to save the scrape job.

  1. Select the desired Confluent Cloud resource under Resource Type.

  2. Copy and paste the associated Confluent Cloud resource ID into Resource ID.

  3. When you’ve added all of the resources you wish to monitor, click Save Scrape Job.

You’ll see a success page and can navigate to the dashboards that have been installed.

Dashboards

After you have successfully configured the Confluent Cloud integration, prebuilt dashboards will be installed in your Grafana instance to help you monitor your Confluent Cloud services.

Managing Your integration

After you’ve successfully configured a scrape job, no other management is needed. Grafana Cloud will manage the scraping of metrics from Confluent Cloud into Grafana Cloud.

You can view, edit, or delete your existing scrape jobs at any time by navigating to back to the integration, via the Integrations and Connections button (lightning bolt icon) on the left hand side and selecting the Confluent Cloud tile.

Resources

The Confluent Cloud integration allows you to pull in metrics from the following Confluent Cloud resources:

  • Kafka Cluster
  • Kafka Connector
  • KsqlDB
  • Schema Registry

Metrics

Below is a list of the metrics per resource that are automatically written to your Grafana Cloud instance when you select a resource to connect to. The metrics will be named using the following naming convention:

Kafka Cluster

Metric NameLabels
confluent_kafka_server_received_bytestopic
confluent_kafka_server_sent_bytestopic
confluent_kafka_server_received_recordstopic
confluent_kafka_server_sent_recordstopic
confluent_kafka_server_retained_bytestopic
confluent_kafka_server_request_counttype, principal_id
confluent_kafka_server_active_connection_countprincipal_id
confluent_kafka_server_partition_count
confluent_kafka_server_successful_authentication_countprincipal_id

Kafka Connector

Metric NameLabels
confluent_kafka_connect_received_bytes
confluent_kafka_connect_sent_bytes
confluent_kafka_connect_received_records
confluent_kafka_connect_sent_records
confluent_kafka_connect_dead_letter_queue_records

KsqlDB

Metric NameLabels
confluent_kafka_ksql_streaming_unit_count

Schema Registry

Metric NameLabels
confluent_kafka_schema_registry_schema_count