• drelephant2

    A Checkup with Dr. Elephant: One Year Later

    March 6, 2017

    This post has been updated to note the release of Pepperdata's Application Profiler, a commercial project based on Dr. Elephant. Last April, we announced the first open source release of Dr. Elephant, a performance monitoring and tuning service for Hadoop and Spark jobs. That announcement marked the culmination of two years of internal development work and more...

  • Selfdefined2

    LinkedIn’s Approach to a Self-Defined Programmable Data Center

    March 2, 2017

    Co-authors: Shawn Zandi and Russ White This post originally appeared in Network Computing.   Operating a large scale, rapidly-growing network requires a philosophical change in how you plan, deploy, and operate your infrastructure. At LinkedIn, as we scaled our data center network, it became evident that we needed to provision and build networks not only as...

  • decommissioning1

    Lessons Learned from Decommissioning a Legacy Service

    February 22, 2017

    Last quarter, I worked on a project called “kill-inbox-war.” Inbox-war was a frontend service that served legacy LinkedIn messaging UI, RPC (Remote Procedure Call) endpoints before Rest.li, and some parts of notifications and invitations for LinkedIn. Even though most of the functionality related to messaging had already been moved out of inbox-war before the...

  • Redliner Dependency Components

    Redliner: How LinkedIn Determines the Capacity Limits of...

    February 17, 2017

    Co-authors: Susie Xia and Anant Rao LinkedIn serves more than 467 million members on a global computing infrastructure through...

  • Venice3

    Building Venice with Apache Helix

    February 15, 2017

    Background Like many internet companies, LinkedIn has faced data growth challenges. Naturally, distributed storage systems became the...

  • feature1

    Open Sourcing Dex Test Parser

    February 10, 2017

    Part of LinkedIn’s 3x3 pipeline for building and releasing mobile applications involves making the cycle for testing changes to the...