• diagram-showing-the-scoring-models-for-detecting-harassment

    The technology behind fighting harassment on LinkedIn

    August 12, 2020

    Co-authors: Grace Tang, Pavan K. Ganganahalli Marulappa, Montinee Khunvirojpanich, and Ting Chen LinkedIn is an active professional community where our members come to stay informed, build meaningful relationships, and find a job. In order for members to confidently engage in this community, they have to feel safe. This sense of safety is at risk when spam,...

  • chart-showing-the-state-transition-timing

    Improving Espresso availability with preemptive Helix-managed traffic shift

    August 11, 2020

    Co-authors: Gaurav Mishra, Song Lu, Antony Curtis, Shuangyang Yang Espresso is LinkedIn's horizontally scalable, highly-available, and elastic data-as-a-service platform that serves nearly 95% of our online storage traffic. Given its position in our tech stack, an optimization in Espresso availability can have a major impact on our members’ experience. In this...

  • diagram-showing-hadoop-dual-ingest-pipelines

    Theory vs. Practice: Learnings from a recent Hadoop incident

    August 6, 2020

    Co-authors: Sandhya Ramu and Vasanth Rajamani For companies and organizations, failure tends to be far more illuminating than success and the lingering effects of a failure can be harmful if the team moves too quickly and does not resolve the issue in a thorough and transparent manner. We recently ran into a large incident that involved data loss in our big data...

  • qualified-applicant-model-design-

    Quality matches via personalized AI for hirer and seeker...

    July 30, 2020

    Co-authors: Konstantin Salomatin, Kirill Talanine, Barış Özmen, Gungor Polatkan, Linda Fayad, Arjun Kulothungun, and Deepak Kumar Our...

  • detext-title-card

    DeText: A deep NLP framework for intelligent text...

    July 28, 2020

    Co-authors: Weiwei Guo, Xiaowei Liu, Sida Wang, Huiji Gao, and Bo Long Natural language processing (NLP) technologies are widely...

  • liquid-the-soul-of-a-new-graph-database

    LIquid: The soul of a new graph database, Part 1

    July 23, 2020

    Co-authors: Scott Meyer, Andrew Carter, and Andrew Rodriguez Editor’s note: In this two-part blog series, we introduce LIquid, a new...