Open Source Articles

  • Solving Espresso’s scalability and performance challenges to support our member base

    September 7, 2023

    Espresso is the database that we designed to power our member profiles, feed, recommendations, and hundreds of other Linkedin applications that handle large amounts of data and need both high performance and reliability. As Espresso continued to expand in support of our 950M+ member base, the number of network connections that it needed began to drive...

  • Open Sourcing iris-message-processor

    August 30, 2023

    One measure of a successful network is uptime - providing consistent, reliable service for members and customers. If there are frequent connection errors or downtime notifications, it becomes difficult to deliver an experience where people can connect and interact with ease. When faced with uptime challenges, being able to quickly escalate issues to network...

  • Declarative Data Pipelines with Hoptimator

    June 26, 2023

    For the last several years, internal infrastructure at LinkedIn has been built around a self-service model, enabling developers to onboard themselves with minimal support. We have various user experiences that let application teams provision their own resources and infrastructure, generally by filling out forms or using command-line tools. For example,...

  • Open Sourcing AvroTensorDataset: A Performant TensorFlow...

    June 15, 2023

    Co-authors: Jonathan Hung, Pei-Lun Liao, Lijuan Zhang, Abin Shahab, Keqiu Hu TensorFlow is one of the most popular frameworks we use...

  • How LinkedIn Adopted A GraphQL Architecture for Product...

    April 25, 2023

    With the widespread adoption of Rest.li since its inception in 2013, LinkedIn has built thousands of microservices to enable the...

  • LinkedIn’s GraphQL journey for integrations and...

    October 6, 2022

    Co-authors: Mimi Chen, Calvin Lei, and Amit Yadav Background LinkedIn’s mission is to connect the world’s professionals to make them...