tools Articles

  • lag-alert-graphs

    An inside look at LinkedIn’s data pipeline monitoring system

    October 30, 2019

    Co-authors: Krishnan Raman and Joey Salacup   Monitoring big data pipelines often equates to waiting for a long-running batch job to complete and observing the status of the execution. The status can result in “Failed” or “Successful” or even “Incomplete.” From there, it’s the team’s job to understand the impact and troubleshoot the situation to identify a...

  • pipeline-cache

    Who Depends On Me? Serving Dependency Queries at Scale

    August 8, 2019

    Co-authors: Yu Li, Szymon Gizecki, and Chinmaya Dattathri To ensure we have significant flexibility in how our teams collaborate, our trunk-based engineering development workflow manages dependencies on a binary level, instead of source level. This requires very efficient and sophisticated management of the resulting dependency graph, and we discussed our...

  • mphealth1

    Health Score Metrics as a Software Craftsmanship Enabler

    October 3, 2017

    The notion of software craftsmanship is sometimes a muddy one. On the one hand, engineers find it hard to grasp and materialize craftsmanship, which is an abstract objective that, by itself, provides little guidance to the software engineering practice. On the other hand, craftsmanship is often narrowed down to a handful of "best practices" that engineers are...

  • ELR-library-request-workflow

    External Library Management

    August 25, 2017

    At LinkedIn, when our engineers create software, there is often a need to leverage some of the great work done by the open source...

  • jarvis5

    JARVIS: Helping LinkedIn Navigate its Source Code

    August 22, 2017

    Codesearch is vital for any tech organization that operates at a large scale, and LinkedIn depends heavily on it. Engineers at...

  • Great Tools for Engineers

    Great Tools for Engineers: Refactoring Across Multiple Code...

    January 20, 2017

    LinkedIn engineers require tooling that scales really well, and we never stop improving it. Even at a smaller scale, providing great...