data center Articles

  • Skyfall: eBPF agent for infrastructure observability

    October 4, 2022

    Currently, LinkedIn infrastructure is composed of hundreds of thousands of hosts across multiple data centers. Observability into our infrastructure makes it possible for us to focus on the health and performance of our critical services to provide the best experience to our members. With LinkedIn's large infrastructure growth over the past few years,...

  • image-of-sonic-buffer-scheduler-configuration

    Scaling storage in the datacenter with RoCE

    May 2, 2022

    Co-authors: Ishan Shah, Alasdair James King, and Zhenggen Xu To support the consistent growth in hyperscale environments, our infrastructure relies on a plethora of storage databases and data processing nodes across its fleet. Those services reap performance benefits from NVMe’s (Non Volatile Memory Express) super-low latency. Currently, many services still use...

  • diagram-showing-hadoop-dual-ingest-pipelines

    Theory vs. Practice: Learnings from a recent Hadoop incident

    August 6, 2020

    Co-authors: Sandhya Ramu and Vasanth Rajamani For companies and organizations, failure tends to be far more illuminating than success and the lingering effects of a failure can be harmful if the team moves too quickly and does not resolve the issue in a thorough and transparent manner. We recently ran into a large incident that involved data loss in our big data...

  • traffic-routing-architecture

    Eliminating toil with fully automated load testing

    December 6, 2019

    Introduction In 2013, when LinkedIn moved to multiple data centers across the globe, we needed a way to redirect traffic from one data...

  • featuredimage7

    LinkedIn Contributes Open19 Technology to the Open Compute ...

    March 15, 2019

    Last year, we announced that LinkedIn had become a Platinum member of the Open Compute Project (OCP). The move was a natural fit for...

  • open19featuredimage

    LinkedIn Begins Contributing Open19 Platform to the...

    September 27, 2018

    Last summer, LinkedIn helped announce the launch of the Open19 Foundation and our role as a founding member. Our aim was to assist in...