Posts by Todd Palino

Two and a half years ago, the Data Infrastructure SRE team at LinkedIn introduced Burrow, an advanced way to monitor Apache Kafka consumer clients, in a previous blog post. At the time, we knew it was a gap that needed to be filled, but we were still surprised by how quickly Burrow was adopted by many other companies. Over time, a number of issues were...

One of the responsibilities of the Data Infrastructure SRE team is to monitor the Apache Kafka infrastructure, the core pipeline for much of LinkedIn's data, in the most effective way to ensure 100% availability. We have recently developed a new method for monitoring Kafka consumers that we are pleased to release as an open source project - Burrow. Named after...

LinkedIn Engineering builds state of the art systems and algorithms that connect the world's professionals to make them more productive and successful. Up and down the stack, from best of class distributed systems like Apache Kafka to cutting edge mobile frameworks and take-no-prisoners machine learning infrastructure, LinkedIn Engineering solves the hardest,...