This post is the second in a series discussing asynchronous processing and multithreading in Apache Samza. In the previous post, we explored the design and architecture of the new AsyncStreamTask API and the asynchronous event loop. In this post, we will focus on the study of the performance of this feature with benchmark Samza jobs. Some of the interesting...

Posts by Xinyu Liu
-
- Topics:
- Apache Samza,
- Stream Processing,
- Big Data,
- Kafka
-
Asynchronous Processing and Multithreading in Apache Samza, Part I: Design and Architecture
Xinyu Liu January 4, 2017
As part of the Apache Samza 0.11 release, we rebuilt Samza’s underlying event processing engine to use an asynchronous and parallel processing model. The new model is unique among current open source stream processors because it not only supports running traditional synchronous processing in parallel on multiple threads, but also provides first-class support for...
- Topics:
- Apache Samza,
- Stream Processing,
- Big Data,
- Kafka