Over a decade ago, test strategies invested heavily in UI-driven tests. Backend and mid-tier services were tested using automated UI-based tests. While UI-based tests have certain merits, such as testing user flows, they are also time-consuming and fragile. The strong coupling of tests with UI caused several problems: Tests needed frequent modification due to...
Stream Processing Articles
-
- Topics:
- Apache Samza,
- Stream Processing,
- Apache Kafka,
- Testing
-
This post is the second in a series discussing asynchronous processing and multithreading in Apache Samza. In the previous post, we explored the design and architecture of the new AsyncStreamTask API and the asynchronous event loop. In this post, we will focus on the study of the performance of this feature with benchmark Samza jobs. Some of the interesting...
- Topics:
- Apache Samza,
- Stream Processing,
- Apache Kafka,
- Big Data
-
As part of the Apache Samza 0.11 release, we rebuilt Samza’s underlying event processing engine to use an asynchronous and parallel processing model. The new model is unique among current open source stream processors because it not only supports running traditional synchronous processing in parallel on multiple threads, but also provides first-class support for...
- Topics:
- Apache Samza,
- Stream Processing,
- Apache Kafka,
- Big Data
-
This post is the second in a series of posts that discuss some of the hard problems in stream processing. In the previous post, we...
- Topics:
- Apache Samza,
- Stream Processing,
- Apache Kafka,
- Big Data,
- Kafka,
- Samza
-
We live in an age where we want to know relevant things happening around the world as soon as they happen; an age where digital...
- Topics:
- Stream Processing,
- Big Data,
- Apache Samza,
- Apache Kafka,
- realtime,
- Kafka,
- Samza
-
Update Apr 13, 2016: There are numerous improvement to Samza cachestore (SAMZA-658, SAMZA-812, SAMZA-873 etc.) since our last test...