Pinot Articles

  • PartitionConsumer-objects-distribution

    Auto-Tuning Pinot Real-Time Consumption

    July 11, 2019

    Pinot, a scalable distributed columnar OLAP data store developed at LinkedIn, delivers real-time analytics for site-facing use cases such as LinkedIn's Who viewed my profile, Talent insights, and more. Pinot uses Apache Helix for managing cluster resources and Apache Zookeeper to store metadata. Pinot has wide adoption at LinkedIn, ranging from internal...

  • star-tree-data-structure

    Star-Tree Index: Powering Fast Aggregations on Pinot

    June 14, 2019

    Pinot is an open source, scalable distributed OLAP data store that entered the Apache Incubation recently. Developed at LinkedIn, it works across a wide variety of production use cases to deliver real-time, low latency analytics. One of the biggest challenges in Pinot is achieving and maintaining tight SLA on latency and throughput on large data sets. Existing...

  • alert-screenshot

    Smart Alerts in ThirdEye, LinkedIn’s Real-Time Monitoring Platform

    June 3, 2019

    Earlier this year, we published a blog post sharing details on ThirdEye, LinkedIn’s comprehensive platform for real-time monitoring and root cause analysis. LinkedIn relies on ThirdEye to monitor a wide spectrum of metrics, ranging from product health to high-level business metrics, and also including machine learning model performance. While monitoring is a...

  • pinotlogo1

    Pinot Joins Apache Incubator

    March 12, 2019

    Pinot is a scalable distributed OLAP data store developed at LinkedIn to deliver real-time, low latency analytics. Pinot’s powerful...

  • thirdeye1

    Introducing ThirdEye: LinkedIn’s Business-Wide Monitoring...

    January 9, 2019

    At LinkedIn, we have many different monitoring systems—each with its own role and granularity— ranging from quarterly reports about...

  • Early Architecture

    A Brief History of Scaling LinkedIn

    July 20, 2015

    LinkedIn started in 2003 with the goal of connecting to your network for better job opportunities. It had only 2,700 members the first...