Data Articles

  • diagram-showing-hadoop-dual-ingest-pipelines

    Theory vs. Practice: Learnings from a recent Hadoop incident

    August 6, 2020

    Co-authors: Sandhya Ramu and Vasanth Rajamani For companies and organizations, failure tends to be far more illuminating than success and the lingering effects of a failure can be harmful if the team moves too quickly and does not resolve the issue in a thorough and transparent manner. We recently ran into a large incident that involved data loss in our big data...

  • qualified-applicant-model-design-

    Quality matches via personalized AI for hirer and seeker preferences

    July 30, 2020

    Co-authors: Konstantin Salomatin, Kirill Talanine, Barış Özmen, Gungor Polatkan, Linda Fayad, Arjun Kulothungun, and Deepak Kumar Our vision at LinkedIn is to create economic opportunity for every member of the global workforce. Key to achieving this is making the marketplace between job seekers and hirers more efficient. Active job seekers apply for many jobs,...

  • liquid-the-soul-of-a-new-graph-database

    LIquid: The soul of a new graph database, Part 1

    July 23, 2020

    Co-authors: Scott Meyer, Andrew Carter, and Andrew Rodriguez Editor’s note: In this two-part blog series, we introduce LIquid, a new graph database built by LinkedIn to support human real-time querying of the economic graph. It is a complete implementation of the relational model that supports fast, constant-time traversal of graph edges with a relational graph...

  • mock-screenshot-of-the-recruiter-usage-dashboard

    Bridging batch and stream processing for the Recruiter...

    July 14, 2020

    Co-authors: Khai Tran and Steve Weiss Batch and streaming computations are often combined together in the Lambda architecture, but...

  • diagram-showing-the-linear-classifier

    A closer look at the AI behind course recommendations on...

    July 1, 2020

    Co-authors: Sneha Chaudhari, Mahesh Joshi, and Gungor Polatkan In part 1 of this series, we shared a high-level overview of our course...

  • monitoring-business-performance-data-with-third-eye-smart-alerts

    Monitoring business performance data with ThirdEye smart...

    June 25, 2020

    Co-authors: Madhumita Mantri and Tyler James At LinkedIn, ThirdEye is used for business and platform health metrics monitoring,...