Big Data
Recently, we launched a significant redesign of the LinkedIn search experience through the Unified Search platform. In this blog post, I'll introduce you to the technology behind three new features in... | Read More
Intra-cluster Replication in Apache Kafka
02/03/2013
Kafka is a distributed publish-subscribe messaging system. In the upcoming version 0.8 release, Kafka will support intra-cluster replication, which increases both the availability and the durability... | Read More
Avatara: OLAP for Web-scale Analytics Products
09/19/2012
We recently presented a paper about Avatara, LinkedIn's scalable, low latency, and highly-available OLAP system for "sharded" multi-dimensional queries. Avatra has been powering our analytical... | Read More
Social Networking in Developing Regions
03/18/2012
We recently published a large-scale data analysis that explored how users from emerging economies are interacting with social networking. We analyzed LinkedIn's unique data set, which includes access... | Read More
Serving Large-scale Batch Computed Data with Project Voldemort
02/25/2012
We've developed a multi-terabyte scale data pipeline from our offline computation layer, Hadoop, to our online serving layer, Project Voldemort.... | Read More
Recap: Improving Hadoop Performance by (up to) 1000x
01/02/2012
Last week, Daniel Abadi visited LinkedIn and talked about "Improving Hadoop Performance by (up to) 1000x." This post is a recap of Abadi's talk, which focused on how HadoopDB could combine the best of... | Read More
Video: 3 Big Data Tech Talks You Can’t Miss
09/19/2011
Sharing knowledge is part of our core culture at LinkedIn, whether through hackdays, contributions to open-source projects and attending conferences. A few months ago, we decided to take knowledge... | Read More
Big Data in Real Time: Processing Data Streams at LinkedIn - a tech talk by Jay Kreps, creator of Kafka and Voldemort
09/08/2011
Come by LinkedIn Headquarters on Thursday, September 15 for a public tech... | Read More
Engineering