Grafana Cloud

Create a custom OpenTelemetry Collector configuration pipeline

With configuration pipelines, you can control collector behavior remotely and at scale. Configuration pipelines are made up of a unique name, a content body, and matching attributes.

This page explains how to create a custom pipeline for OpenTelemetry Collector in the Grafana Fleet Management interface. Type or paste an OpenTelemetry Collector YAML configuration in the configuration editor and then add matching attributes to assign it to specific collectors.

You can also create pipelines from a template. Refer to the integration template setup guide to use a pre-built pipeline.

Before you begin

To create configuration pipelines in Fleet Management, you should:

Define the configuration pipeline

Write a complete OpenTelemetry Collector configuration in YAML and save it as a pipeline.

  1. In your Grafana Cloud stack, click Connections > Fleet Management and then switch to the Remote configuration tab.
  2. Click Create configuration pipeline.
  3. Select the OpenTelemetry collector type.
  4. Click Custom configuration and then Next.
  5. Enter a unique name for the pipeline.
  6. In the configuration editor, write your OpenTelemetry Collector YAML configuration. The configuration must be valid. Refer to OpenTelemetry Collector configuration for more details.
  7. Click Test configuration pipeline to verify the syntax is valid.
  8. Click Next to assign the configuration pipeline to collectors or click Save draft to save an incomplete pipeline.

Assign the configuration pipeline

Configuration pipelines are incomplete until you add matching attributes that assign them to collectors.

Note

If you saved an incomplete pipeline, click the edit icon from the Configuration pipeline list to return to the Define a configuration pipeline page.

  1. Click Next on the Define a configuration pipeline page.
  2. Use the dropdown menus to create a matching attribute. The Collector list updates in real time to show you which collectors have been assigned the configuration pipeline. Only active collectors are displayed in this list by default. Inactive collectors are not shown, but you can include them by updating the status filter.
  3. Continue adding matching attributes as needed. Configuration polling requests to the API can accept a maximum of 25 attributes.
  4. Click Save to activate the configuration pipeline and return to the Configuration pipeline list.
  5. Activate or deactivate a configuration pipeline with a click of the Active switch.
  6. To verify the pipeline details without re-entering the editor, click the pipeline name. You see a details drawer containing pipeline metadata, configuration content, and matched collectors.

Next steps

Now that you’ve started remotely configuring your fleet, learn how to streamline your workflows and track historical changes to your configuration pipelines.