Metadata Articles

  • metadata-library-updates

    Rapid experimentation through standardization: Typed AI features for LinkedIn’s feed

    April 15, 2020

    Serving the most relevant information for LinkedIn members in the homepage feed requires a massive effort—hundreds of features are used to personalize content for hundreds of millions of members. For each homepage visit, our machine learning models have to find and surface the best activity across a member's whole network, and they have to source that content...

  • datahub-logo

    Open sourcing DataHub: LinkedIn’s metadata search and discovery platform

    February 18, 2020

    Co-authors: Kerem Sahin, Mars Lan, and Shirshanka Das Finding the right data quickly is critical for any company that relies on big data insights to make data-driven decisions. Not only does this impact the productivity of data users (including analysts, machine learning developers, data scientists, and data engineers), but it also has a direct impact on end...

  • data-hub-logo

    DataHub: A generalized metadata search & discovery tool

    August 14, 2019

    Co-authors: Mars Lan, Seyi Adebajo, Shirshanka Das As the operator of the world’s largest professional network and the Economic Graph, LinkedIn’s Data team is constantly working on scaling its infrastructure to meet the demands of our ever-growing big data ecosystem. As the data grows in volume and richness, it becomes increasingly challenging for data...