Welcome to TimeShift
This week we have updates and articles from the Grafana Labs team, some initial impressions on our Prometheus-inspired log aggregation project Loki, and lots more. Plus learn how to make your own air quality monitor.
See an article we missed? Contact us.
Latest Beta Release: Grafana v6.1.0-beta1
Major New Features
- Prometheus: Ad-hoc Filtering makes it easier to explore data in a Grafana dashboard.
- Permissions: A new option so that Editors can own dashboards, folders and teams they create. This makes it easier for teams to self-organize when using Grafana.
Check out all the features and bug fixes in the latest beta release.Download Grafana v6.1.0-beta1 Now
From the Blogosphere
Everything You Need to Know About the OSS Licensing War, Part 2.: Part 2 of our OSS licensing war series picks up where we left off: In 2015, AWS had taken the Elasticsearch software and launched their own cloud offering, and Elastic N.V. doubled down on an ‘open core strategy.’
Grafana Logging using Loki: Julien dives into Loki, its architecture, configuration, and some various use-cases.
Tinder & Grafana: A Love Story in Metrics and Monitoring: Two years ago, when it was time for the L.A.-based company to find and implement a perfect metrics monitoring partner, the process proved to be more slow-burn love affair versus whirlwind romance.
Scaling Graphite to Millions of Metrics: The folks at Klaviyo discuss the challenges they overcame to scale their Graphite stack to reliably handle over a million active metric keys at any given time across 17 million total metric keys.
Dynamic Configuration Discovery in Grafana: John provides an introduction to how dynamic configuration discovery works in Grafana for data sources and dashboards.
Build an air quality monitor with InfluxDB, Grafana, and Docker on a Raspberry Pi: Learn how to build your own air quality monitor. Collect metrics for temperature, humidity, barometric pressure, and air quality, and visualize all your data in Grafana.
Timeseries and Timeseries Again (pt. 2): Leon describes his initial impressions of using our Prometheus-inspired log aggregation project Loki in part 2 of his series focused on the metrics stack he uses at work. Check out part 1 to get up to speed.
How to deploy Telegraf, InfluxDB, and Grafana with Puppet Bolt: Check out a demo to configure and deploy monitoring stack via Puppet Modules.
What’s New in Prometheus 2.8: WAL-Based Remote Write: Learn about Prometheus’ new Write-Ahead Logging (WAL) for the remote_write API, which was included in the Prometheus 2.8 release. It’s a change intended to safeguard client metrics in the face of any network issues.
#### Grafana Plugin Update Three plugin updates to share this week. Update or install any plugin on your on-prem Grafana via the grafana-cli tool, or update with one-click on Hosted Grafana.
WorldPing App - WorldPing v1.2.5 has been released which adds support for Grafana v6.0 and includes a few minor bug fixes.
Polystat Panel - Polystat panel v1.0.16 has been released and includes a fix for variable encoding in clickthrough urls.
Instana Data Source - The latest update of the Instana data source has lots of bug fixes as well as some new features:
- Application metrics have been added
- The datasource connection check has been improved
- Support added for
In between code pushes we like to speak at, sponsor and attend all kinds of conferences and meetups. We also like to make sure we mention other Grafana-related events happening all over the world. If you’re putting on just such an event, let us know and we’ll list it here.
Callum Styan: Grafana Loki - Log Aggregation for Incident Investigations - Get an inside look at Grafana Labs' latest open source log aggregation project Loki, and learn how to better investigate issues using Grafana's new Explore UI.Register Now
May 21 - Tom Wilkie, Intro: Cortex
May 22 - Tom Wilkie, Deep Dive: Cortex
Cortex provides horizontally scalable, highly available, multi-tenant, long term storage for [Prometheus](/oss/prometheus/) metrics, and a horizontally scalable, Prometheus-compatible query API. Cortex allows users to deploy a centralized, globally aggregated view of all their Prometheus instances, storing data indefinitely. In this talk we will discuss the benefits of, and how to deploy, a fully disaggregated, microservice oriented Cortex architecture. We'll also discuss some of the challenges operating Cortex at scale, and what the future holds for Cortex. Cortex is a CNCF sandbox project.
May 23 - Tom Wilkie, Grafana Loki: Like Prometheus, But for logs.
Loki is a horizontally-scalable, highly-available log aggregation system inspired by Prometheus. It is designed to be cost effective and easy to operate, as it does not index the contents of the logs, but rather labels for each log stream.
Loki initially targets Kubernetes logging, using Prometheus service discovery to gather labels for log streams. As such, Loki enables you to easily switch between metrics and logs, streamlining the incident response process - a workflow we have built into the latest version of Grafana.
In this talk we will discuss the motivation behind Loki, its design and architecture, and what the future holds. Its early days after the launch at KubeCon Seattle, but so far the response to the project has been overwhelming, with more the 4.5k GitHub stars and over 12hrs at the top spot on Hacker News.
May 23 - David Kaltschmidt, Fool-Proof Kubernetes Dashboards for Sleep-Deprived Oncalls
Software running on Kubernetes can fail in various, but surprisingly well-defined ways. In this intermediate-level talk David Kaltschmidt shows how structuring dashboards in a particular way can be a helpful guide when you get paged in the middle of the night. Reducing cognitive load makes oncall more effective. When dashboards are organized hierarchically on both the service and the resource level, troubleshooting becomes an exercise of divide and conquer. The oncall person can quickly eliminate whole areas of problems and zone in on the real issue. At that point a single service or instance should have been identified, for which more detailed debugging can take place.
Tom Wilkie: Grafana Loki - Grafana Loki: Like Prometheus, But for logs. - Loki is a horizontally-scalable, highly-available log aggregation system inspired by Prometheus. It is designed to be cost effective and easy to operate, as it does not index the contents of the logs, but rather labels for each log stream.Learn More
Tom Wilkie: Grafana Loki - Prometheus-inspired open source logging - Imagine if you had Prometheus for log files. In this talk we'll discuss Grafana Loki, our attempt at creating just that.Learn More
David Kaltschmidt - Mixing metrics and logs with Grafana + Influx - Imagine if you had Prometheus for log files. In this talk we'll discuss Grafana Loki, our attempt at creating just that.Learn More
Have fun solving real world problems building the next generation of open source tools from anywhere in the world. Check out all of our current opportunities on our careers page.View All our Open Positions
How are we doing?
We’re always looking to make TimeShift better. If you have feedback, please let us know! Email or send us a tweet, or post something at our community forum.