ESPRESSO Articles

  • Nuage1

    Reducing the MTTD and MTTR of LinkedIn’s Private Cloud

    October 14, 2016

    Nuage (French for “cloud”) is what we call LinkedIn’s internal cloud management portal. It allows LinkedIn developers to quickly create new datastores like Kafka topics, Voldemort stores, and Espresso databases, to name just a few in the LinkedIn data centers. The product consists of an HTTP frontend available to LinkedIn developers and a rest.li backend service...

  • Android Test Butler

    Open Sourcing Test Butler

    August 4, 2016

    Automated testing is a key component to LinkedIn’s 3x3 strategy for releasing mobile applications. As we developed the new LinkedIn Android app, we found that our tests had a major problem: our testing environment was unreliable, so our tests failed intermittently. We needed a solution that would let us rely on our tests to inform us when there was a problem...

  • Kafka Ecosystem at LinkedIn

    April 19, 2016

    Apache Kafka is a highly scalable messaging system that plays a critical role as LinkedIn’s central data pipeline. Kafka was developed at LinkedIn back in 2010, and it currently handles more than 1.4 trillion messages per day across over 1400 brokers. Kafka’s strong durability and low latency have enabled us to use Kafka to power a number of newer...

  • Profile Service Architecture

    Tuning Espresso’s JVM Performance

    January 15, 2016

    (Co-author: Amit Balode) Profile in Espresso The member profile page is one of the most-visited pages on LinkedIn. It allows other...

  • Early Architecture

    A Brief History of Scaling LinkedIn

    July 20, 2015

    LinkedIn started in 2003 with the goal of connecting to your network for better job opportunities. It had only 2,700 members the first...

  • Kafka at LinkedIn: Current and Future

    January 29, 2015

    The LinkedIn engineering team has developed and built Apache Kafka into a powerful open source solution for managing streams of...