Kafka Articles

  • ShareAnalytics1

    New Analytics for Sharing on LinkedIn: See Who’s Viewed Your Post

    November 1, 2016

    Coauthor: Bharath Kumarasubramanian   If you’re sharing content on LinkedIn, you’re positioning yourself as a thought leader among the largest group of professionals assembled on the web. With more than 460 million members, LinkedIn is the place you want to be to share your expertise and discuss issues that matter to you with other like-minded professionals. But...

  • Nuage1

    Reducing the MTTD and MTTR of LinkedIn’s Private Cloud

    October 14, 2016

    Nuage (French for “cloud”) is what we call LinkedIn’s internal cloud management portal. It allows LinkedIn developers to quickly create new datastores like Kafka topics, Voldemort stores, and Espresso databases, to name just a few in the LinkedIn data centers. The product consists of an HTTP frontend available to LinkedIn developers and a rest.li backend service...

  • streamprocess1

    Stream Processing Hard Problems Part II: Data Access

    August 22, 2016

    This post is the second in a series of posts that discuss some of the hard problems in stream processing. In the previous post, we explored the use of lambda architecture in stream processing and discussed techniques to avoid it. In this post, we’ll focus on one of the main bottlenecks in high scale stream processing applications: “accessing data.” Background...

  • Stream Processing Hard Problems – Part 1: Killing Lambda

    June 27, 2016

    We live in an age where we want to know relevant things happening around the world as soon as they happen; an age where digital...

  • Kafka Ecosystem at LinkedIn

    April 19, 2016

    Apache Kafka is a highly scalable messaging system that plays a critical role as LinkedIn’s central data pipeline. Kafka was developed...

  • Gobblin Gobbles Camus, Looks Towards the Future

    April 13, 2016

    We shared Gobblin with the open source community a year ago. Since then, we’ve seen increasing interest and adoption among engineers,...