• chart-showing-the-state-transition-timing

    Improving Espresso availability with preemptive Helix-managed traffic shift

    August 11, 2020

    Co-authors: Gaurav Mishra, Song Lu, Antony Curtis, Shuangyang Yang Espresso is LinkedIn's horizontally scalable, highly-available, and elastic data-as-a-service platform that serves nearly 95% of our online storage traffic. Given its position in our tech stack, an optimization in Espresso availability can have a major impact on our members’ experience. In this...

  • diagram-showing-hadoop-dual-ingest-pipelines

    Theory vs. Practice: Learnings from a recent Hadoop incident

    August 6, 2020

    Co-authors: Sandhya Ramu and Vasanth Rajamani For companies and organizations, failure tends to be far more illuminating than success and the lingering effects of a failure can be harmful if the team moves too quickly and does not resolve the issue in a thorough and transparent manner. We recently ran into a large incident that involved data loss in our big data...

  • qualified-applicant-model-design-

    Quality matches via personalized AI for hirer and seeker preferences

    July 30, 2020

    Co-authors: Konstantin Salomatin, Kirill Talanine, Barış Özmen, Gungor Polatkan, Linda Fayad, Arjun Kulothungun, and Deepak Kumar Our vision at LinkedIn is to create economic opportunity for every member of the global workforce. Key to achieving this is making the marketplace between job seekers and hirers more efficient. Active job seekers apply for many jobs,...

  • detext-title-card

    DeText: A deep NLP framework for intelligent text...

    July 28, 2020

    Co-authors: Weiwei Guo, Xiaowei Liu, Sida Wang, Huiji Gao, and Bo Long Natural language processing (NLP) technologies are widely...

  • liquid-the-soul-of-a-new-graph-database

    LIquid: The soul of a new graph database, Part 1

    July 23, 2020

    Co-authors: Scott Meyer, Andrew Carter, and Andrew Rodriguez Editor’s note: In this two-part blog series, we introduce LIquid, a new...

  • rebuilding-messaging-how-we-bootstrapped-our-platform

    Rebuilding messaging: How we bootstrapped our platform

    July 21, 2020

    Co-authors: Pradhan Cadabam and Jingxuan (Rex) Zhang Messaging has been a core part of Linkedin since the day we launched and our...