ESPRESSO Articles

• 

  Migrating to Espresso

  David Max August 2, 2017

  Espresso is LinkedIn's strategic distributed, fault-tolerant NoSQL database that powers many LinkedIn services. Espresso has a large production footprint at LinkedIn, with close to a hundred clusters in use, storing about 420 terabytes of Source of Truth (SoT) data and handling more than two million queries per second at peak load. This post discusses our...

  • Topics:
  • database,
  • NYC Engineering,
  • ESPRESSO
• 

  Reducing the MTTD and MTTR of LinkedIn’s Private Cloud

  Gustaf Helgesson October 14, 2016

  Nuage (French for “cloud”) is what we call LinkedIn’s internal cloud management portal. It allows LinkedIn developers to quickly create new datastores like Kafka topics, Voldemort stores, and Espresso databases, to name just a few in the LinkedIn data centers. The product consists of an HTTP frontend available to LinkedIn developers and a rest.li backend service...

  • Topics:
  • Performance,
  • ESPRESSO,
  • LPS,
  • Kafka,
  • Voldemort
• 

  Open Sourcing Test Butler

  Drew Hannay August 4, 2016

  Automated testing is a key component to LinkedIn’s 3x3 strategy for releasing mobile applications. As we developed the new LinkedIn Android app, we found that our tests had a major problem: our testing environment was unreliable, so our tests failed intermittently. We needed a solution that would let us rely on our tests to inform us when there was a problem...

  • Topics:
  • Craftsmanship,
  • Android,
  • Mobile,
  • ESPRESSO,
  • Testing
• 

  Kafka Ecosystem at LinkedIn

  Joel Koshy April 19, 2016

  Apache Kafka is a highly scalable messaging system that plays a critical role as LinkedIn’s central data pipeline. Kafka was developed...

  • Topics:
  • Conferences,
  • ESPRESSO,
  • Kafka,
  • Open Source
• 

  Tuning Espresso’s JVM Performance

  Shawn Nguyen January 15, 2016

  (Co-author: Amit Balode) Profile in Espresso The member profile page is one of the most-visited pages on LinkedIn. It allows other...

  • Topics:
  • Performance,
  • Profile,
  • ESPRESSO,
  • site speed,
  • Garbage Collection
• 

  A Brief History of Scaling LinkedIn

  Josh Clemm July 20, 2015

  LinkedIn started in 2003 with the goal of connecting to your network for better job opportunities. It had only 2,700 members the first...

  • Topics:
  • scale,
  • rest.li,
  • Play,
  • Open Source,
  • Galene,
  • Pinot,
  • engineering culture,
  • ESPRESSO,
  • Kafka,
  • inversion,
  • Architecture,
  • Voldemort,
  • operations,
  • Java,
  • Search,
  • Samza