We shared Gobblin with the open source community a year ago. Since then, we’ve seen increasing interest and adoption among engineers, researchers and analysts in using Gobblin to integrate data from a variety of sources into Hadoop. In previous blog posts, publications, and talks, we’ve described our motivations for building a unified ingestion framework that is...
Hadoop Articles
-
- Topics:
- Hadoop,
- Data Ingestion,
- Gobblin,
- Kafka,
- Open Source
-
We are proud to announce today that we are open sourcing Dr. Elephant, a powerful tool that helps users of Hadoop and Spark understand, analyze, and improve the performance of their flows. We first presented Dr. Elephant to the community last year during the eighth annual Hadoop Summit, a leading conference for the Apache Hadoop community. Hadoop is a framework...
- Topics:
- Spark,
- Hadoop,
- Dr. Elephant,
- Open Source
-
Co-authors: Vamshi Hardageri, Brian Jue Sizr is an interactive visualization tool developed at LinkedIn for the Hadoop Distributed file system (HDFS). It provides insights into HDFS disk space and namespace utilization. It can forecast and track weekly, monthly and quarterly growth, and detect inefficient file storage. This post outlines the need for this tool,...
-
Genesis Less than a year ago, we introduced Gobblin, a unified ingestion framework, to the world of Big Data. Since then, we’ve shared...
- Topics:
- Big Data,
- Hadoop,
- Open Source,
- Distributed Systems,
- ETL,
- Gobblin,
- Kafka
-
Co-authors: Teja Thotapalli Brian Jue Tu Tran Sandhya Ramu As LinkedIn continues to grow in size and stature, the data volume being...
- Topics:
- Hadoop,
- operations
-
I'm proud to announce that the Hadoop Dev Team at LinkedIn has open-sourced the LinkedIn Gradle Plugin for Apache Hadoop ("Hadoop...