ESPRESSO Articles

• 

  Reducing the MTTD and MTTR of LinkedIn’s Private Cloud

  Gustaf Helgesson October 14, 2016

  Nuage (French for “cloud”) is what we call LinkedIn’s internal cloud management portal. It allows LinkedIn developers to quickly create new datastores like Kafka topics, Voldemort stores, and Espresso databases, to name just a few in the LinkedIn data centers. The product consists of an HTTP frontend available to LinkedIn developers and a rest.li backend service...

  • Topics:
  • Performance,
  • ESPRESSO,
  • LPS,
  • Kafka,
  • Voldemort
• 

  Open Sourcing Test Butler

  Drew Hannay August 4, 2016

  Automated testing is a key component to LinkedIn’s 3x3 strategy for releasing mobile applications. As we developed the new LinkedIn Android app, we found that our tests had a major problem: our testing environment was unreliable, so our tests failed intermittently. We needed a solution that would let us rely on our tests to inform us when there was a problem...

  • Topics:
  • Craftsmanship,
  • Android,
  • Mobile,
  • ESPRESSO,
  • Testing
• 

  Kafka Ecosystem at LinkedIn

  Joel Koshy April 19, 2016

  Apache Kafka is a highly scalable messaging system that plays a critical role as LinkedIn’s central data pipeline. Kafka was developed at LinkedIn back in 2010, and it currently handles more than 1.4 trillion messages per day across over 1400 brokers. Kafka’s strong durability and low latency have enabled us to use Kafka to power a number of newer...

  • Topics:
  • Conferences,
  • ESPRESSO,
  • Kafka,
  • Open Source
• 

  Tuning Espresso’s JVM Performance

  Shawn Nguyen January 15, 2016

  (Co-author: Amit Balode) Profile in Espresso The member profile page is one of the most-visited pages on LinkedIn. It allows other...

  • Topics:
  • Performance,
  • Profile,
  • ESPRESSO,
  • site speed,
  • Garbage Collection
• 

  A Brief History of Scaling LinkedIn

  Josh Clemm July 20, 2015

  LinkedIn started in 2003 with the goal of connecting to your network for better job opportunities. It had only 2,700 members the first...

  • Topics:
  • scale,
  • rest.li,
  • Play,
  • Open Source,
  • Galene,
  • Pinot,
  • engineering culture,
  • ESPRESSO,
  • Kafka,
  • inversion,
  • Architecture,
  • Voldemort,
  • operations,
  • Java,
  • Search,
  • Samza
• 

  Kafka at LinkedIn: Current and Future

  Mammad Zadeh January 29, 2015

  The LinkedIn engineering team has developed and built Apache Kafka into a powerful open source solution for managing streams of...

  • Topics:
  • Apache Kafka,
  • ESPRESSO,
  • Kafka,
  • Open Source,
  • Samza