Developer Productivity Articles

  • PartitionConsumer-objects-distribution

    Auto-Tuning Pinot Real-Time Consumption

    July 11, 2019

    Pinot, a scalable distributed columnar OLAP data store developed at LinkedIn, delivers real-time analytics for site-facing use cases such as LinkedIn's Who viewed my profile, Talent insights, and more. Pinot uses Apache Helix for managing cluster resources and Apache Zookeeper to store metadata. Pinot has wide adoption at LinkedIn, ranging from internal...

  • High-level-architecture

    Expediting Data Fixes and Data Migrations

    July 9, 2019

    With over 630 million members, the LinkedIn platform delivers thousands of features that individually serve and store large amounts of diverse data. Protecting, maintaining, and serving data has always been of paramount importance for enriching the member experience and ensuring service reliability. In this blog post, we’ll address a critical part of data...

  • proml1

    Scaling Machine Learning Productivity at LinkedIn

    January 3, 2019

    Co-authors: Joel Young, Bee-Chung Chen, Bo Long, Marius Seritan, and Priyanka Gariba   The rate at which artificial intelligence (AI) knowledge is being disseminated and the rate of change in applied AI technologies show no signs of slowing down. Today’s software engineers are increasingly learning machine learning (ML) strategies as undergraduate students, and...

  • ELR-library-request-workflow

    External Library Management

    August 25, 2017

    At LinkedIn, when our engineers create software, there is often a need to leverage some of the great work done by the open source...

  • Bootcamp Keynote

    Building LinkedIn's New Engineering Bootcamp

    August 12, 2015

    Jeff Weiner famously compared managing a company in hypergrowth to launching a rocket - “If your trajectory is off by inches at launch...

  • Composable and streamable Play apps

    January 21, 2014

    At LinkedIn, we've been using the Play Framework in production for over a year. At the 2014 Ping Conference, I gave a talk about some...