Version 2.4 release notes
Loki 2.4 focuses on two items:
- Making it easier to get your logs into Loki.
- Making Loki easier to run and operate. Anyone not using Kubernetes or avoiding microservices should pay close attention: this release has a lot for you.
Features and enhancements
- Loki no longer requires logs to be sent in perfect chronological order. Support for out of order logs is one of the most highly requested features for Loki. The strict ordering constraint has been removed.
- Scaling Loki is now easier with a hybrid deployment mode that falls between our single binary and our microservices. The Simple scalable deployment scales Loki with new
writetargets. Where previously you would have needed Kubernetes and the microservices approach to start tapping into Loki’s potential, it’s now possible to do this in a simpler way.
- The new
common_configsection results in a 70% smaller Loki configuration. Pair that with updated defaults and Loki comes out of the box with more appropriate defaults and limits. Check out the example local configuration as the new reference for running Loki.
- Recording rules are no longer an experimental feature. We’ve given them a more resilient implementation which leverages the existing write ahead log code in Prometheus.
- The new Promtail Kafka Consumer can easily get your logs out of Kafka and into Loki.
- There are nice LogQL enhancements, thanks to the amazing Loki community. LogQL now has group_left and group_right. And, the
line_formatfunctions now support working with dates and times.
- Another great community contribution allows Promtail to accept ndjson and plaintext log files over HTTP.
All in all, about 260 PR’s went into Loki 2.4, and we thank everyone for helping us make the best Loki yet.
For a full list of all changes please look at the CHANGELOG.
Please read the upgrade guide before updating Loki.
We made a lot of changes to Loki’s configuration as part of this release. We have tried our best to make sure changes are compatible with existing configurations, however some changes to default limits may impact users who didn’t have values explicitly set for these limits in their configuration files.
Here is a list of limit defaults that have changed:
|config||new default||old default|
|max_global_streams_per_user||5000||0 (no limit)|
|max_query_length||“721h”||“0h” (no limit)|
|max_streams_per_user||0 (no limit)||10000|
We have enabled the in-memory FIFO cache by default when no existing external cache is configured. This helps improve Loki’s performance, however it will also allow Loki to consume more memory.
2.4.1 bug fixes
2.4.1 fixes two important bugs in the 2.4.0 release:
- PR 4687 owen-d: Eliminate a compactor panic when not using a tenant overrides file.
- PR 4681 slim-bean: Correct the initialization of the
readtarget. Incorrect initialization resulted in query gaps after a chunk was flushed and before the querier downloaded new index tables.
2.4.0 bug fixes
Here are some of the more important fixes in version 2.4.0:
- PR 4598 kavirajk: Fix the IP matcher lexer to differentiate a filter from an identifier.
- PR 4563 cyriltovena: Fixes the Series function to properly handle sharding.
- PR 4518 slim-bean: Fixes a bug in which items are returned to a sync.Pool incorrectly.
- PR 4411 slim-bean: Fixes a frontend bug which caused it to wait for results which would never arrive.
- PR 4238 liguozhong: Fixes a distributor goroutine leak.
2.4.0 security fixes
Version 2.4.0 contains one security-related fix:
PR 4627 Explicitly define allowed HTTP methods on HTTP endpoints.
A community user noticed that all Loki endpoints would respond to HTTP OPTIONS requests, and the proxy they placed in front of Loki responsible for HTTP authentication would pass OPTIONS requests unauthenticated to Loki, allowing users to make unauthenticated/unauthorized queries to Loki. The fix restricts the type of HTTP methods allowed on each endpoint and disallows OPTIONS requests.
Related Loki resources
Be the first to learn about exciting next-generation features in Grafana 8.0, be inspired by what community members are building, and attend expert-led sessions and workshops on Grafana, Prometheus, Loki logs, and more.
Logging with Loki: Essential configuration settings
This webinar focuses on Loki configuration, picking up where we left off at the end of the Intro to Loki webinar.