infrastructure Articles

  • nuage-architecture

    Solving manageability challenges at scale with Nuage

    September 16, 2019

    Introduction LinkedIn is committed to providing economic opportunities for every member of the global workforce, and we’re growing at a rapid pace. Our platform is built on a collection of large-scale multi-cluster services functioning in harmony to offer a unified product experience to members.  The aim of several backend engineering teams is to allow other...

  • data-hub-logo

    Data Hub: A Generalized Metadata Search & Discovery Tool

    August 14, 2019

    Co-authors: Mars Lan, Seyi Adebajo, Shirshanka Das As the operator of the world’s largest professional network and the Economic Graph, LinkedIn’s Data team is constantly working on scaling its infrastructure to meet the demands of our ever-growing big data ecosystem. As the data grows in volume and richness, it becomes increasingly challenging for data...

  • LinkedIn_Tech_Update

    Building the next version of our infrastructure

    July 23, 2019

    The pursuit of our mission to connect the world’s professionals to make them more productive and successful is deeply dependent on the technology and infrastructure we build and maintain. Ten years ago, we had 50 million members. Fast forward five years and that number jumped to 300 million. Today, we have more than 645 million members, 20 million jobs and...

  • change-data-capture

    Open Sourcing Brooklin: Near Real-Time Data Streaming at...

    July 16, 2019

    Brooklin - a distributed service for streaming data in near real-time and at scale - has been running in production at LinkedIn since...

  • PartitionConsumer-objects-distribution

    Auto-Tuning Pinot Real-Time Consumption

    July 11, 2019

    Pinot, a scalable distributed columnar OLAP data store developed at LinkedIn, delivers real-time analytics for site-facing use cases...

  • High-level-architecture

    Expediting Data Fixes and Data Migrations

    July 9, 2019

    With over 630 million members, the LinkedIn platform delivers thousands of features that individually serve and store large amounts of...