Update Apr 13, 2016: There are numerous improvement to Samza cachestore (SAMZA-658, SAMZA-812, SAMZA-873 etc.) since our last test runs. Those fixes improve two cases' (rocksdb only and rocksdb with changelog) performance dramatically. We reran those two cases and are reposting the numbers here. Per node throughput is about 1.1 million messages / sec with...
Data Articles
-
- Topics:
- Performance,
- Apache Samza,
- Stream Processing,
- performance analysis,
- Kafka,
- Data
-
If you had the right data, what could you do to create economic opportunity for every professional in the world? Since we announced the LinkedIn Economic Graph Challenge last month, we’ve received strong interest and initial proposals that have us excited about the outcomes of the Challenge. If yours is not one of them, you should get moving. The deadline for...
- Topics:
- Data
-
Less than a year ago, we announced the first open source release of Apache Incubator Samza, a framework for processing big data streams. Today we are releasing Samza 0.7.0, a big milestone that reflects Samza's growing maturity. This is a good opportunity to look back at how far we've come in the last year. Samza is no longer a research project, but is now...
- Topics:
- Stream Processing,
- Data,
- Data Streams,
- Performance,
- Agility,
- Kafka,
- Samza
-
I joined LinkedIn about six years ago at a particularly interesting time. We were just beginning to run up against the limits of our...
- Topics:
- Logs,
- Stream Processing,
- Hadoop,
- Data,
- Distributed Systems,
- ETL,
- Kafka