Apache Kafka is a highly scalable messaging system that plays a critical role as LinkedIn’s central data pipeline. Kafka was developed at LinkedIn back in 2010, and it currently handles more than 1.4 trillion messages per day across over 1400 brokers. Kafka’s strong durability and low latency have enabled us to use Kafka to power a number of newer...
ESPRESSO Articles
-
- Topics:
- Conferences,
- ESPRESSO,
- Kafka,
- Open Source
-
Co-authors: Shawn Nguyen and Amit Balode Profile in Espresso The member profile page is one of the most-visited pages on LinkedIn. It allows other members to learn about a member's professional identity, experiences and interests. It’s crucial to make sure that profile views return as fast as possible. In this post, we’ll talk about our approach for handling...
- Topics:
- Performance,
- Profile,
- ESPRESSO,
- site speed,
- Garbage Collection
-
LinkedIn started in 2003 with the goal of connecting to your network for better job opportunities. It had only 2,700 members the first week. Fast forward many years, and LinkedIn’s product portfolio, member base, and server load has grown tremendously. Today, LinkedIn operates globally with more than 350 million members. We serve tens of thousands of web pages...
- Topics:
- scale,
- rest.li,
- Play,
- Open Source,
- Galene,
- Pinot,
- engineering culture,
- ESPRESSO,
- Kafka,
- inversion,
- Architecture,
- Voldemort,
- operations,
- Java,
- Search,
- Samza
-
The LinkedIn engineering team has developed and built Apache Kafka into a powerful open source solution for managing streams of...
- Topics:
- ESPRESSO,
- Kafka,
- Open Source,
- Samza
-
Authors: Aditya Auradkar, Tom Quiggle Espresso is LinkedIn's online, distributed, fault-tolerant NoSQL database that currently powers...
- Topics:
- Big Data,
- Distributed Systems,
- ESPRESSO