Co-authors: Xiang Zhang and Jingyu Zhu Introduction The Lambda architecture has become a popular architectural style that promises both speed and accuracy in data processing by using a hybrid approach of both batch processing and stream processing methods. But it also has some drawbacks, such as complexity and additional development/operational overheads. One of...
Architecture Articles
-
- Topics:
- Stream Processing,
- Pinot,
- Profile,
- Architecture,
- Kafka,
- batch processing
-
In the previous blog posts of our “Rebuilding messaging” series, we shared the process of how we designed the system from high-level product and engineering requirements, and how we bootstrapped the data. In this post, we’ll explore why we made extensibility a core aspect of our messaging platform, what that meant for our partner teams, and how we got it done....
- Topics:
- infrastructure,
- Architecture,
- Product Design
-
Co-authors: Pradhan Cadabam and Jingxuan (Rex) Zhang Messaging has been a core part of Linkedin since the day we launched and our system behind it has evolved tremendously over the past 17 years. However, the architecture of our messaging backend largely remained unchanged until a recent ground-up overhaul. In the second part of our “Rebuilding messaging” series...
- Topics:
- infrastructure,
- Architecture,
- Product Design
-
Co-authors: Tyler Grant, Armen Hamstra, Cliff Snyder Over the last five years, the number of messages sent on LinkedIn has quadrupled....
- Topics:
- infrastructure,
- Architecture,
- Product Design
-
Co-authors: Xiang Zhang, Estella Pham, and Ke Wu Identity services are critical systems that serve data on profile and member settings...
- Topics:
- A/B Testing,
- Architecture,
- experimentation,
- Performance,
- ESPRESSO,
- T-REX,
- Data
-
Co-authors: Suruchi Shah and Hari Shankar The rise of instant messaging has changed how we communicate. Compared to the back-and-forth...
- Topics:
- Performance,
- infrastructure,
- Architecture,
- Search