scale Articles

  • liquid-the-soul-of-a-new-graph-database

    LIquid: The soul of a new graph database, Part 1

    July 23, 2020

    Co-authors: Scott Meyer, Andrew Carter, and Andrew Rodriguez Editor’s note: In this two-part blog series, we introduce LIquid, a new graph database built by LinkedIn to support human real-time querying of the economic graph. It is a complete implementation of the relational model that supports fast, constant-time traversal of graph edges with a relational graph...

  • Azure-Front-Door-map

    Scaling LinkedIn’s Edge with Azure Front Door

    June 16, 2020

    Co-authors: Viranch Mehta, Jon Sorenson, Samir Jafferali As LinkedIn has grown to more than 690 million members, we’ve expanded our edge platform to 19 Points of Presence (PoPs) across 5 continents over the years to be closer to our members and provide a quick and reliable experience. As we started evaluating how to best scale for the future needs of our...

  • building-a-platform-for-assessments

    Building a platform: Learnings from our pursuit for leverage

    April 3, 2020

    Co-authors: Jefferson Lai, Vinyas Maddi, and Vijay Ramamurthy One of our core engineering principles here at LinkedIn is to create leverage. In practice, what this means is to build software that is easy to reuse by other teams. An effective way we are able to do this is to favor platforms that generalize long-term functionality rather than build inflexible,...

  • schema-management-workflow

    Advanced schema management for Spark applications at scale

    March 25, 2020

    Co-authors: Walaa Eldin Moustafa, Wenye Zhang, Adwait Tumbde, Ratandeep Ratti Introduction Over the years, the popularity of Apache...

  • data-sentinel-logo

    Data Sentinel: Automating data validation

    March 10, 2020

    Co-authors: Arun Swami, Sriram Vasudevan, Sailesh Mittal, Jiefu Zheng, Joojay Huyn, Audrey Alpizar, Changling Huang, Maneesh Varshney,...

  • stages-in-continuous-deployment

    Learnings from the journey to continuous deployment

    October 18, 2019

    As an engineer, your goal is for every commit to seamlessly land in production and provide a delightful experience for your customers....