Co-authors: Keqiu Hu, Jonathan Hung, Haibo Chen, and Sriram Rao At LinkedIn, we use Hadoop as our backbone for big data analytics and machine learning. With an exponentially growing data volume, and the company heavily investing in machine learning and data science, we have been doubling our cluster size year over year to match the compute workload growth. Our...
Open Source Articles
-
- Topics:
- Hadoop,
- Data,
- Open Source
-
Co-authors: Ze Mao, Matt Wise, Casey Getz, Justin Lin, Ashish Singhai, and Rob Block Introduction Ambry is LinkedIn's scalable geo-distributed object store. Developed in-house and open sourced in 2016, Ambry stores tens of petabytes of data. At LinkedIn, Ambry is used to store objects like photos, videos, and resume uploads, as well as internal binary data....
- Topics:
- infrastructure,
- Data,
- Storage,
- Open Source
-
Co-authors: Kirill Talanine, Jeffrey D. Gee, Rohan Ramanath, Konstantin Salomatin, Gungor Polatkan, Onkar Dalal, and Deepak Kumar Introduction A common challenge for production machine learning systems is reacting to change. The world can change quickly, particularly on a social network. This can range from sweeping changes at the scale of the whole economy...
-
Co-authors: Kinjal Basu, Yao Pan, Rohan Ramanath, Konstantin Salomatin, Amol Ghoting, and S. Sathiya Keerthi Building thriving...
- Topics:
- artificial intelligence,
- scale,
- machine learning,
- Open Source
-
Co-authors: Keqiu Hu, Jonathan Hung, and Junfan Zhang Today, TonY is joining the LF AI & Data Foundation, an umbrella foundation of...
- Topics:
- artificial intelligence,
- Hadoop,
- machine learning,
- Open Source
-
In March, LinkedIn joined the recently announced Mobile Native Foundation (MNF), a Linux Foundation project launched with the support...
- Topics:
- Mobile,
- iOS,
- Testing,
- Open Source