Per stream export
Note
Per stream export is currently in public preview. Grafana Labs offers limited support, and breaking changes might occur prior to the feature being made generally available.
The Cloud Logs Export feature lets you sync logs stored in Grafana Cloud Logs with an object storage bucket that you own. By default, Cloud Logs Export sends all of your logs to your cloud storage provider. However, you may only need to export certain log streams, and exporting unnecessary streams leads to unnecessary object storage costs. To maximize cost savings, you may want to only export a subset of the logs you ingest to long term storage.
The ability to export only certain streams is currently in Public Preview, available to Cloud Pro and Cloud Advanced users via support ticket.
When you contact support, you should provide a list of inclusive stream selectors (labels) for the data you want to export and the date to start applying the filter, for example:
selector=`{region="AMER"}`
startDate="2025-02-01"
or
selector=`{namespace="production", service_name="grafana"}`
startDate="2024-12-05"
- When no selector is applicable to a given date (due to no selector configured or startDate not reached), all logs are exported to your cloud storage provider.
- If at least one filter is applicable, only data matching the applicable filters are exported.
- You can have multiple filters, each with their own start dates.
- The filter has to be a valid logql stream selector and will follow existing logql validation policies.
- Filters have a
startDate
. When you export logs, a filter with astartDate
is only applied to logs that were ingested after thestartDate
.
As per stream export is a public preview, there are a few known limitations:
- Visibility into which streams are configured for retention is not provided.
- Per-stream export can only be configured through a support ticket, and not through the Cloud Logs Export user interface.