The Trade Desk recently moved from an old monitoring system based on Nagios, Graphite, and a number of homegrown pieces of software, to something more standard, based on Prometheus. SRE Patrick O’Brien talked about the lessons they learned along the way.
Coming Soon: Seamless and Cost-Effective Meta Tags for Metrictank One of the major projects we’re working on for Metrictank – our large scale Graphite solution – is the meta tags feature, which we started last year and are targeting to release in a few months. A lot of people don’t realize this, but Graphite has had tag support for more than a year. Our mission with Metrictank is to provide a more scalable version of Graphite, so introducing meta tags was a logical next step.
At GrafanaCon EU 2018, Booking.com System Administrator Vladimir Smirnov gave a talk about why the company started to use Graphite almost five years ago, and how he and his team scaled it to handle millions of metrics per second.
The Road to Graphite 1.1 I started working on Graphite just over a year ago, when @obfuscurity asked me to help out with some issues blocking the Graphite 1.0 release. Little did I know that a year later, that would have resulted in 262 commits (and counting), and that with the help of the other Graphite maintainers (especially @deniszh, @iksaif & @cbowman0) we would have added a huge amount of new functionality to Graphite.
The first time I saw the Graphite project I didn’t really understand what I was looking at. My previous exposure to metrics and graphing was mostly limited to Cacti, so I didn’t immediately comprehend the power and simplicity that this new (at the time) tool offered. Over the years I went from curious bystander to empowered user to wanna-be developer to project member, and eventually, to be the unofficial maintainer-slash-face of the project.
My name is Raj Dutt, and I am the co-founder and CEO of raintank, Inc. As many of you know, raintank is the company behind Grafana, which our co-founder Torkel created as a front-end for Graphite almost 3 years ago. Today, Grafana supports dozens of different time series databases. Overall, we think Graphite is pretty awesome. Originally written by Chris Davis at Orbitz in 2006, it has helped many thousands of companies achieve a quantum leap in how they handled their metrics.
For several years I’ve worked with Graphite, Grafana and statsd on a daily basis and have been participating in the community. All three are fantastic tools and solve very real problems. Hence my continued use and recommendation. However, between colleagues, random folks on irc, and personal experience, I’ve seen a plethora of often subtle issues, gotchas and insights, which today I’d like to share. I hope this will prove useful to users while we, open source monitoring developers, work on ironing out these kinks.