Venice Articles

  • diagram-illustrating-memory-allocation-in-glibc-malloc

    Taming memory fragmentation in Venice with Jemalloc

    January 28, 2021

    Sometimes, an engineering problem arises that might make us feel like maybe we don't know what we're doing, or at the very least, forces us out of the comfort zone of our area of expertise. That day came for the Venice team at Linkedin when we began to notice that some Venice processes would consume all available memory and crash if given enough time to run....

  • venice-performance-optimization-1

    Venice Performance Optimization

    April 11, 2018

    Over the last two years at LinkedIn, we have been working on a distributed key-value database called “Venice.” Venice is designed to be a significant improvement to Voldemort Read-Only for serving derived data. We’ve built out the rest of the functionality to complete the dream that motivated the construction of Venice: the ability to consume data from both...

  • production_software2

    Building Venice: A Production Software Case Study

    April 4, 2017

    We build a lot of our own infrastructure systems here at LinkedIn. Many people have heard of Kafka, our distributed message buffer. We also run various databases, blob stores, and stream and image processing systems, all of which we develop, deploy, and maintain in-house. One of the systems we've been working on recently is Venice, a distributed derived...

  • Venice3

    Building Venice with Apache Helix

    February 15, 2017

    Editor's note: This blog has been updated. Background Like many internet companies, LinkedIn has faced data growth challenges....