• streamprocess1

    Stream Processing Hard Problems Part II: Data Access

    August 22, 2016

    This post is the second in a series of posts that discuss some of the hard problems in stream processing. In the previous post, we explored the use of lambda architecture in stream processing and discussed techniques to avoid it. In this post, we’ll focus on one of the main bottlenecks in high scale stream processing applications: “accessing data.” Background...

  • cgroups1

    Don’t Let Linux Control Groups Run Uncontrolled

    August 18, 2016

    Coauthors: Cuong Tran and Jerry Weng Summary The Linux kernel feature of cgroups (Control Groups) is being increasingly adopted for running applications in multi-tenanted environments. Many projects (e.g., Docker and CoreOS) rely on cgroups to limit resources such as CPU and memory. Ensuring the high performance of the applications running in cgroups is very...

  • Pygradle1

    Introducing {py}gradle, an open source Python plugin for Gradle

    August 16, 2016

    Image Credit: Yiying Lu, Copyright: Gradle Inc. Gradle is a build automation tool that supports many programming languages. It coordinates the process of building software between multiple different code repositories and automates a number of important related tasks, like checking dependencies and warning programmers if something they have changed might break...

  • LinkedIn at KDD 2016

    LinkedIn Researchers Present New Findings at KDD2016

    August 15, 2016

    This week, researchers and scientists in areas like machine learning, data mining, and analytics are meeting in San Francisco for the...

  • HackDayFollowup3

    Recap from LinkedIn’s Intern HackDay

    August 11, 2016

    On July 15-16, LinkedIn held its sixth Annual Intern HackDay at our headquarters in Mountain View, California. More than a thousand...

  • IPv6

    IPv6 Inside LinkedIn Part II

    August 9, 2016

    Coauthor: Tim Crofts In Part I of this series, we explained why we decided to move our internal network over to IPv6. The LinkedIn...