Co-authors: Xiang Zhang and Jingyu Zhu Introduction The Lambda architecture has become a popular architectural style that promises both speed and accuracy in data processing by using a hybrid approach of both batch processing and stream processing methods. But it also has some drawbacks, such as complexity and additional development/operational overheads. One of...
Pinot Articles
-
- Topics:
- Stream Processing,
- Pinot,
- Profile,
- Architecture,
- Kafka,
- batch processing
-
Co-authors: Khai Tran and Steve Weiss Batch and streaming computations are often combined together in the Lambda architecture, but carry the cost of maintaining two different code bases for the same logic. We have previously shared on the blog a behind-the-scenes look at our approach into enabling the seamless translation of declarative batch code into streaming...
- Topics:
- Stream Processing,
- batch processing,
- Data,
- Pinot,
- Gobblin,
- Kafka,
- Samza
-
Co-authors: Timothy Santos and Jeremy Lwanga LinkedIn is a mission-driven organization, and we take our mission of “connecting the world's professionals to make them more productive and successful” very seriously. One way we’ve worked toward this goal is through LinkedIn Talent Insights, which first launched in 2018. This is a tool that helps organizations...
- Topics:
- Pinot,
- Product Design
-
Co-authors: Madhumita Mantri and Tyler James At LinkedIn, ThirdEye is used for business and platform health metrics monitoring,...
- Topics:
- artificial intelligence,
- monitoring,
- Pinot,
- machine learning,
- metrics,
- Data
-
Built at LinkedIn, Pinot is an open source, distributed, and scalable OLAP data store that we use as our de-facto near-real-time...
- Topics:
- Pinot,
- metrics,
- Data,
- Open Source
-
Co-authors: Yen-Jung Chang, Yang Yang, Xiaohui Sun, and Tie Wang At LinkedIn, ThirdEye is the backbone of our monitoring toolkit. We...
- Topics:
- monitoring,
- Pinot,
- metrics,
- Data