Our streams infrastructure powers all of our near real-time data processing, serving as LinkedIn’s application backbone. Developed at LinkedIn, Apache Kafka, Apache Samza, and Brooklin form this world-class data processing infrastructure, which enables the experiences of our more than 660 million members.
Apache Kafka is a core part of our is a core part of our infrastructure at LinkedIn. It was originally developed in-house as a stream processing platform and was subsequently open sourced. Today, it’s widely used by the industry, has an active community, and few companies — if any — do so at LinkedIn’s scale.