• Kafka Ecosystem at LinkedIn

    April 19, 2016

    Apache Kafka is a highly scalable messaging system that plays a critical role as LinkedIn’s central data pipeline. Kafka was developed at LinkedIn back in 2010, and it currently handles more than 1.4 trillion messages per day across over 1400 brokers. Kafka’s strong durability and low latency have enabled us to use Kafka to power a number of newer...

  • Upgrade Testing on iOS: Keeping up with 3x3

    April 15, 2016

    Our newly introduced 3x3 release cadence is an effort to keep up in the fast-paced world of native apps where increasing consumer demands and decreasing release cycle times require us to be more agile with our app releases. As a corollary, we have more flexibility to experiment (A/B test) with new features, to make more data-driven design decisions, and most...

  • Gobblin Gobbles Camus, Looks Towards the Future

    April 13, 2016

    We shared Gobblin with the open source community a year ago. Since then, we’ve seen increasing interest and adoption among engineers, researchers and analysts in using Gobblin to integrate data from a variety of sources into Hadoop. In previous blog posts, publications, and talks, we’ve described our motivations for building a unified ingestion framework that is...

  • Getting to Know Kamilah Taylor

    April 12, 2016

    LinkedIn wouldn't be the company it is today without the engineers who built it. We have no shortage of talented individuals in...

  • Open Sourcing Dr. Elephant

    April 8, 2016

    We are proud to announce today that we are open sourcing Dr. Elephant, a powerful tool that helps users of Hadoop and Spark understand...

  • 3x3: iOS Build Speed and Stability

    April 7, 2016

    At the beginning of last year, alongside the development of Project Voyager, LinkedIn’s new flagship mobile application, we started...