Configure Beyla Prometheus and OpenTelemetry data export
Grafana Cloud

Configure Beyla Prometheus and OpenTelemetry data export

Beyla can export OpenTelemetry metrics and traces to a OTLP endpoint.

To send metrics directly to the Grafana Cloud OpenTelemetry endpoint, see the Grafana Cloud OTLP endpoint configuration.

Grafana Cloud OTLP endpoint

You can configure the component under the grafana top-level YAML section, otlp subsection, or via environment variables. You can configure Beyla to submit OpenTelemetry data to the Grafana Cloud OTEL endpoint using custom variables, allowing an easier setup of the endpoint and the authentication.

For example:

yaml
grafana:
  otlp:
    cloud_zone: prod-eu-west-0
    cloud_instance_id: 123456

You can also use the standard OpenTelemetry variables to submit the metrics and traces to any standard OpenTelemetry endpoint, including Grafana Cloud.

Lowercase YAML option
Uppercase environment variable option
DescriptionTypeDefault
cloud_submit
GRAFANA_CLOUD_SUBMIT
A list of data types to submit to the OTLP endpoint. Accepts metrics and traces as values.stringtraces
cloud_zone
GRAFANA_CLOUD_ZONE
The cloud zone of your Grafana endpoint used to compose the Grafana OTLP URL. Refer to cloud zone configuration for important details about endpoint overrides.string
cloud_instance_id
GRAFANA_CLOUD_INSTANCE_ID
Your Grafana user name. Usually a number but must be set as a string in the YAML file.string
cloud_api_key
GRAFANA_CLOUD_API_KEY
API key of your Grafana Cloud account.string

Cloud zone configuration

If any of the OTEL_EXPORTER_OTLP_ENDPOINT, OTEL_EXPORTER_OTLP_METRICS_ENDPOINT or OTEL_EXPORTER_OTLP_TRACES_ENDPOINT variables are defined, they override the destination endpoint, and Beyla ignores the cloud_zone configuration option.

OpenTelemetry metrics exporter component

Enable the OpenTelemetry metrics export component by setting the endpoint attribute in your configuration file or via an environment variable, refer to metric export configuration options.

Configure the component under the otel_metrics_export section of your YAML configuration or via environment variables.

In addition to the configuration documented in this article, the component supports environment variables from the standard OpenTelemetry exporter configuration.

Beyla uses lowercase fields for YAML configuration and uppercase names for environment variable configuration.

Lowercase YAML option
Uppercase environment variable option
DescriptionTypeDefault
endpoint
OTEL_EXPORTER_OTLP_METRICS_ENDPOINT
The endpoint Beyla sends metrics to.URL
OTEL_EXPORTER_OTLP_ENDPOINTThe shared endpoint for metrics and traces exporters. Beyla adds /v1/metrics path to the URL when sending metrics, following the OpenTelemetry standard. To prevent this behavior, use the metrics specific setting.URL
protocol
OTEL_EXPORTER_OTLP_METRICS_PROTOCOL
The protocol transport/encoding of the OpenTelemetry endpoint, refer to metrics export protocol. Accepted values http/json, http/protobuf, and grpc.stringInferred from port usage
OTEL_EXPORTER_OTLP_PROTOCOLSimilar to the shared endpoint, the protocol for metrics and traces.stringInferred from port usage
insecure_skip_verify
BEYLA_OTEL_INSECURE_SKIP_VERIFY
If true, Beyla skips verifying and accepts any server certificate. Only override this setting for non-production environments.booleanfalse
interval
BEYLA_METRICS_INTERVAL
The duration between exports.Duration60s
features
BEYLA_OTEL_METRICS_FEATURES
The list of metric groups Beyla exports data for, refer to metrics export features. Accepted values application, application_span, application_service_graph, application_process, network and network_inter_zone.list of strings["application"]
allow_service_graph_self_references
BEYLA_OTEL_ALLOW_SERVICE_GRAPH_SELF_REFERENCES
Controls if Beyla includes self-referencing services in service graph generation, for example a service that calls itself. Self referencing reduces service graph usefulness and increases data cardinality.booleanfalse
instrumentations
BEYLA_OTEL_METRICS_INSTRUMENTATIONS
The list of metrics instrumentation Beyla collects data for, refer to metrics instrumentation section.list of strings["*"]
bucketsSets how you can override bucket boundaries of diverse histograms, refer to override histogram buckets.(n/a)Object
histogram_aggregation
OTEL_EXPORTER_OTLP_METRICS_DEFAULT_HISTOGRAM_AGGREGATION
Sets the default aggregation Beyla uses for histogram instruments. Accepted values explicit_bucket_histogram or base2_exponential_bucket_histogram.stringexplicit_bucket_histogram

Metrics export protocol

If you don’t set a protocol Beyla sets the protocol as follows:

  • grpc: if the port ends in 4317, for example 4317, 14317, or 24317.
  • http/protobuf: if the port ends in 4318, for example 4318, 14318, or 24318.

Metrics export features

The Beyla metrics exporter can export the following metrics data groups for processes matching entries in the metrics discovery configuration.

  • application: Application-level metrics
  • application_span Application-level trace span metrics
  • application_service_graph: Application-level service graph metrics. It’s recommended to use a DNS for service discovery and to ensure the DNS names match the OpenTelemetry service names Beyla uses. In Kubernetes environments, the OpenTelemetry service name set by the service name discovery is the best choice for service graph metrics.
  • application_process: Metrics about the processes that runs the instrumented application
  • network: Network-level metrics, refer to the network metrics configuration documentation to learn more

Metrics instrumentation

The list of instrumentation areas Beyla can collection data from:

  • *: all instrumentation, if * is present Beyla ignores other values
  • http: HTTP/HTTPS/HTTP2 application metrics
  • grpc: gRPC application metrics
  • sql: SQL database client call metrics
  • redis: Redis client/server database metrics
  • kafka: Kafka client/server message queue metrics

For example, setting the instrumentations option to: http,grpc enables the collection of HTTP/HTTPS/HTTP2 and gRPC application metrics, and disables other instrumentation.

OpenTelemetry traces exporter component

You can configure the component under the otel_traces_export section of your YAML configuration or via environment variables.

In addition to the configuration documented in this article, the component supports the environment variables from the standard OpenTelemetry exporter configuration.

Lowercase YAML option
Uppercase environment variable option
DescriptionTypeDefault
endpoint
OTEL_EXPORTER_OTLP_TRACES_ENDPOINT
OTEL_EXPORTER_OTLP_ENDPOINT
The endpoint Beyla sends traces to. When using OTEL_EXPORTER_OTLP_ENDPOINT, Beyla follows the OpenTelemetry standard and automatically adds /v1/traces path to the URL. If you don’t want this to happen, use the traces specific setting.URL
protocol
OTEL_EXPORTER_OTLP_TRACES_PROTOCOL
OTEL_EXPORTER_OTLP_PROTOCOL
The protocol transport/encoding of the OpenTelemetry endpoint, refer to traces export protocol. Accepted values http/json, http/protobuf, and grpc.stringInferred from port usage
insecure_skip_verify
BEYLA_OTEL_INSECURE_SKIP_VERIFY
If true, Beyla skips verifying and accepts any server certificate. Only override this setting for non-production environments.booleanfalse
instrumentations
BEYLA_OTEL_TRACES_INSTRUMENTATIONS
The list of instrumentation Beyla collects data for, refer to traces instrumentation section.list of strings["*"]

Traces export protocol

If you don’t set a protocol Beyla sets the protocol as follows:

  • grpc: if the port ends in 4317, for example 4317, 14317, or 24317.
  • http/protobuf: if the port ends in 4318, for example 4318, 14318, or 24318.

Traces instrumentation

The list of instrumentation areas Beyla can collection data from:

  • *: all instrumentation, if * is present Beyla ignores other values
  • http: HTTP/HTTPS/HTTP2 application traces
  • grpc: gRPC application traces
  • sql: SQL database client call traces
  • redis: Redis client/server database traces
  • kafka: Kafka client/server message queue traces

For example, setting the instrumentations option to: http,grpc enables the collection of HTTP/HTTPS/HTTP2 and gRPC application traces, and disables other instrumentation.

Prometheus exporter component

You can configure the component under the prometheus_export section of your YAML configuration or via environment variables. This component opens an HTTP endpoint in the auto-instrumentation tool that allows any external scraper to pull metrics in Prometheus format. It is enabled if the port property is set.

Note

The Prometheus scraper might override the values of the instance and job labels. To keep the original values as set by Beyla, refer to the Grafana Alloy Prometheus scraper component documentation.

Lowercase YAML option
Uppercase environment variable option
DescriptionTypeDefault
port
BEYLA_PROMETHEUS_PORT
The HTTP port for the Prometheus scrape endpoint. If unset or 0, no Prometheus endpoint is open.int
path
BEYLA_PROMETHEUS_PATH
The HTTP query path to fetch the list of Prometheus metrics.string/metrics
extra_resource_attributes
BEYLA_PROMETHEUS_EXTRA_RESOURCE_ATTRIBUTES
A list of additional resource attributes to be added to the reported target_info metric. Refer to extra resource attributes for important details about runtime discovered attributes.list of strings
ttl
BEYLA_PROMETHEUS_TTL
The duration after which metric instances are not reported if they haven’t been updated. Used to avoid reporting indefinitely finished application instances.Duration5m
bucketsSets how you can override bucket boundaries of diverse histograms, refer to override histogram buckets.Object
features
BEYLA_PROMETHEUS_FEATURES
The list of metric groups Beyla exports data for, refer to Prometheus export features.list of strings["application"]
allow_service_graph_self_references
BEYLA_PROMETHEUS_ALLOW_SERVICE_GRAPH_SELF_REFERENCES
Does Beyla include self-referencing service in service graph generation. Self referencing isn’t useful for service graphs and increases data cardinality.booleanfalse
instrumentations
BEYLA_PROMETHEUS_INSTRUMENTATIONS
The list of instrumentation Beyla collects data for, refer to Prometheus instrumentation section.list of strings["*"]

Prometheus extra resource attributes

Due to internal limitations of the Prometheus API client, Beyla needs to know beforehand which attributes are exposed for each metric. This would cause that some attributes that are discovered at runtime, during instrumentation, won’t be visible by default. For example, attributes defined on each application via Kubernetes annotations, or in the target application’s OTEL_RESOURCE_ATTRIBUTES environment variable.

For example, an application defining the OTEL_RESOURCE_ATTRIBUTES=deployment.environment=production as environment variable, the target_info{deployment.environment="production"} attribute would be visible by default if the metrics are exported via OpenTelemetry but not if they are exported via Prometheus.

To make deployment_environment visible in Prometheus, you need to add it to the extra_resource_attributes list.

Prometheus export features

The Prometheus metrics exporter can export the following metrics data groups:

  • application: Application-level metrics
  • application_span: Application-level trace span metrics
  • application_service_graph: Application-level service graph metrics. It’s recommended to use a DNS for service discovery and to ensure the DNS names match the OpenTelemetry service names Beyla uses. In Kubernetes environments, the OpenTelemetry service name set by the service name discovery is the best choice for service graph metrics.
  • application_process: Metrics about the processes that runs the instrumented application
  • network: Network-level metrics, refer to the network metrics configuration documentation to learn more
  • network_inter_zone: Network inter-zone metrics, refer to the network metrics configuration documentation to learn more

Prometheus instrumentation

The list of instrumentation areas Beyla can collection data from:

  • *: all instrumentation, if * is present Beyla ignores other values
  • http: HTTP/HTTPS/HTTP2 application metrics
  • grpc: gRPC application metrics
  • sql: SQL database client call metrics
  • redis: Redis client/server database metrics
  • kafka: Kafka client/server message queue metrics

For example, setting the instrumentations option to: http,grpc enables the collection of HTTP/HTTPS/HTTP2 and gRPC application metrics, and disables other instrumentation.