When dealing with massive amounts of data at scale, it’s important to have state of the art infrastructure and algorithms that can make sense of all that information. I lead the Data Analytics Infrastructure team at LinkedIn; we work on core infrastructure components such as Hadoop and Spark, as well as develop other infrastructure to support analytics use cases...
Posts by Kapil Surlaker
-
- Topics:
- Pinot,
- data analytics,
- Cubert,
- infrastructure,
- Gobblin
-
Talent is LinkedIn’s number one operating priority and we have no shortage of talented individuals in technical roles across the company. These are the folks that create, build and maintain our platform, tools and features - as well as write the posts for this blog. We’re going to start giving some of the people and personalities that make LinkedIn great a...
- Topics:
- infrastructure,
- engineering culture,
- data analytics
-
We are very pleased to announce the open source release of Helix- a generic cluster management system for managing partitioned and replicated resources in distributed systems. Check out Helix on Github now! Helix makes distributed system development simpler by separating cluster management from the primary component tasks of a distributed system. What is Helix?...
- Topics:
- Cluster Management,
- Distributed Systems,
- Open Source
-
A couple weeks ago, Professor John Ousterhout visited LinkedIn to give a tech talk called "RAMCloud: Scalable High-Performance Storage...
- Topics:
- Video,
- Architecture,
- Storage
-
Update: missed this tech talk? We've got you covered. Check out the video here. Come by LinkedIn Headquarters on Wednesday, October 12...
- Topics:
- Architecture,
- Storage,
- Event