Open Source Articles

  • How LinkedIn Adopted A GraphQL Architecture for Product Development

    April 25, 2023

    With the widespread adoption of Rest.li since its inception in 2013, LinkedIn has built thousands of microservices to enable the exchange of data with our engineers and our external partners. Though this microservice architecture has worked out really well for our API engineers, when our clients need to fetch data they find themselves talking to several of these...

  • LinkedIn’s GraphQL journey for integrations and partnerships: How we accelerated development by 90%

    October 6, 2022

    Co-authors: Mimi Chen, Calvin Lei, and Amit Yadav Background LinkedIn’s mission is to connect the world’s professionals to make them more productive and successful. One way we advance this mission is by partnering with other organizations to deliver world class integrations. We are developing a platform-as-a-service (PaaS) that provides exploratory access,...

  • Open Sourcing Venice – LinkedIn’s Derived Data Platform

    September 26, 2022

    We are proud to announce the open sourcing of Venice, LinkedIn’s derived data platform that powers more than 1800 of our datasets and is leveraged by over 300 distinct applications. Venice is a high-throughput, low-latency, highly-available, horizontally-scalable, eventually-consistent storage system with first-class support for ingesting the output of batch and...

  • Feathr-joins-LF-AI-and-Data-Foundation

    Feathr joins LF AI & Data Foundation

    September 12, 2022

    Co-authors: Hangfei Lin, Jinghui Mo We’re excited to announce today that Feathr is joining LF AI & Data, the Linux Foundation’s...

  • image-of-a-feather

    Open sourcing Feathr – LinkedIn’s feature store for...

    April 12, 2022

    We are open sourcing Feathr – the feature store we built to simplify machine learning (ML) feature management and improve developer...

  • image-of-the-overview-of-brooklin

    Load-balanced Brooklin Mirror Maker: Replicating...

    April 11, 2022

    At LinkedIn, Apache Kafka is used heavily to store all kinds of data, such as member activity, log storage, metrics storage, and a...