Co-authors: Cong Gu, Abin Shahab, Chen Qiang, Keqiu Hu Editor's note: This post was updated on June 10, 2020 LinkedIn AI has been traditionally Hadoop/YARN based, and we operate one of the world’s largest Hadoop data lakes, with over 4,500 users and 500PB of data. In the last few years, Kubernetes has also become very popular at LinkedIn for Artificial...
Hadoop Articles
-
- Topics:
- Hadoop,
- Security,
- Open Source
-
Co-authors: Christian Mathiesen and Jie Zhang Your LinkedIn profile is intended to be a representative picture of your professional life and career, and a key part of that picture is the skills you’ve acquired. In pursuit of our mission to create a place where everyone has access to opportunities based on the skills they have, we’re rolling out a new way to...
- Topics:
- Hadoop,
- Product Design,
- ESPRESSO
-
On January 30, Hadoop developers gathered at LinkedIn’s offices in Mountain View to share their latest work, with presentations by engineers from community members like Microsoft, Cloudera, Uber, and of course, LinkedIn. The Hadoop community is the lifeblood of the project, and the strong community spread across numerous companies and countries is what has kept...
- Topics:
- Hadoop,
- Data,
- Open Source,
- events
-
Co-authors: Jonathan Hung, Keqiu Hu, and Anthony Hsu LinkedIn heavily relies on artificial intelligence to deliver content and create...
- Topics:
- Hadoop,
- machine learning,
- TensorFlow,
- Data,
- Open Source
-
Co-authors: Erik Krogen and Min Shen In March 2015, LinkedIn’s Big Data Platform team experienced a crisis. As the team was preparing...
- Topics:
- Testing,
- Hadoop,
- Open Source
-
Co-authors: Carl Steinbach and Vasanth Rajamani Big challenges in the big data ecosystem At LinkedIn, we have a number of challenges...