infrastructure Articles

  • building-a-platform-for-assessments

    Building a platform: Learnings from our pursuit for leverage

    April 3, 2020

    Co-authors: Jefferson Lai, Vinyas Maddi, and Vijay Ramamurthy One of our core engineering principles here at LinkedIn is to create leverage. In practice, what this means is to build software that is easy to reuse by other teams. An effective way we are able to do this is to favor platforms that generalize long-term functionality rather than build inflexible,...

  • architecture-of-insearch

    InSearch: LinkedIn’s new message search platform

    March 17, 2020

    Co-authors: Suruchi Shah and Hari Shankar The rise of instant messaging has changed how we communicate. Compared to the back-and-forth of email, we send and receive messages at much higher volumes and speeds. In the instant conversations we have, we also expect to be able to search for important phrases, moments, or references with ease. This rapid increase in...

  • Title card: Preparing your infrastructure for a WFH shift

    Preparing your infrastructure for a WFH shift

    March 13, 2020

    As a step to help reduce the spread of COVID-19, many companies are now encouraging employees to work remotely. Supporting a workforce that’s fully remote, at least at this scale, is new to many businesses, LinkedIn being no exception. In the last couple of weeks, our 16,000+ employees have transitioned from being a mostly centralized workforce in a set of...

  • datahub-logo

    Open sourcing DataHub: LinkedIn’s metadata search and...

    February 18, 2020

    Co-authors: Kerem Sahin, Mars Lan, and Shirshanka Das Finding the right data quickly is critical for any company that relies on big...

  • The-new-collaboration-pattern-with-rest-li-and-pegasus

    Empowering our developers with the Nuage SDK

    November 19, 2019

    LinkedIn delivers value to more than 660 million members via thousands of microservices, most of which depend on data infrastructure...

  • lag-alert-graphs

    An inside look at LinkedIn’s data pipeline monitoring...

    October 30, 2019

    Co-authors: Krishnan Raman and Joey Salacup Monitoring big data pipelines often equates to waiting for a long-running batch job to...