Open Source Articles

  • star-tree-data-structure

    Star-Tree Index: Powering Fast Aggregations on Pinot

    June 14, 2019

    Pinot is an open source, scalable distributed OLAP data store that entered the Apache Incubation recently. Developed at LinkedIn, it works across a wide variety of production use cases to deliver real-time, low latency analytics. One of the biggest challenges in Pinot is achieving and maintaining tight SLA on latency and throughput on large data sets. Existing...

  • iris-mobile-view

    Iris Mobile: An Open Source, Mobile Interface for Incident Management

    May 9, 2019

    At LinkedIn, our on-call incidents are managed using Iris and Oncall, two tools that we released as open source to the community about two years ago. Oncall allows our teams to manage their on-call shifts in a largely automated fashion, scheduling rotations without any human intervention. At the same time, it allows teams to be agile and adaptable when defining...

  • ambry-logo

    Introducing Data Compaction in Ambry

    May 8, 2019

    Introduction Three years ago, LinkedIn announced and open sourced Ambry, a distributed, highly available and horizontally scalable immutable object store optimized to store and serve media. As we stated at the time, this was an important update given how vital media content is for any website to increase user engagement, virality, and monetization. Since its...

  • Under The Hood: Learning With Documents

    April 24, 2019

    Co-authors: Anurag Rawat and Kirsten Rauffer LinkedIn Learning aims to be the world’s most engaging learning platform. Learning...

  • avro1

    Avro2TF: An Open Source Feature Transformation Engine for...

    April 4, 2019

    Co-authors: Xuhong Zhang, Chenya Zhang, and Yiming Ma   Today, we are announcing a new open source project called Avro2TF. This...

  • emberconf1

    Recap: LinkedIn at EmberConf 2019

    March 26, 2019

    Photo credit: Jo Chou   Every March, a JavaScript conference called EmberConf is held in Portland, Oregon. EmberConf is the best place...