monitoring Articles

  • alert-screenshot

    Smart Alerts in ThirdEye, LinkedIn’s Real-Time Monitoring Platform

    June 3, 2019

    Earlier this year, we published a blog post sharing details on ThirdEye, LinkedIn’s comprehensive platform for real-time monitoring and root cause analysis. LinkedIn relies on ThirdEye to monitor a wide spectrum of metrics, ranging from product health to high-level business metrics, and also including machine learning model performance. While monitoring is a...

  • samza-aeon-1

    Samza Aeon: Latency Insights for Asynchronous One-Way Flows

    April 19, 2018

    Co-authors: Max Wolffe and Akhilesh Gupta Introduction You can’t fix something if you don’t know there’s a problem. Measuring and tracking the latency of requests through your system is essential to identifying and resolving issues quickly. Many systems have built-in tooling which allows developers to monitor, set alerts on, and inspect the latency of a set of...

  • cruisecontrol2

    Open Sourcing Kafka Cruise Control

    August 28, 2017

    Apache Kafka's popularity has grown tremendously over the past few years. In fact, LinkedIn's deployment recently surpassed 2 trillion messages per day, with over 1,800 Kafka servers (i.e., brokers). While Kafka has proven to be very stable, there are still operational challenges when running Kafka at such a scale. Brokers fail on a daily basis, which results in...

  • ingraphs1

    InGraphs: Monitoring and Unexpected Artwork

    August 3, 2017

    At LinkedIn, we have an internal tool for visualizing operational metrics that we call inGraphs. Since I started working for LinkedIn...

  • inMesh visualization

    inMesh: Real-Time Monitoring of Remote Sites

    April 20, 2016

    Many IT organizations support offices distributed across the world. As the number of remote sites increases, it becomes more and more...

  • Inflow Dashboard

    InFlow - Making the LinkedIn network visible

    March 22, 2016

    To maintain the high network availability needed to serve all LinkedIn applications, we need to monitor and analyse both network...