data science Articles

  • data-hub-logo

    Data Hub: A Generalized Metadata Search & Discovery Tool

    August 14, 2019

    Co-authors: Mars Lan, Seyi Adebajo, Shirshanka Das As the operator of the world’s largest professional network and the Economic Graph, LinkedIn’s Data team is constantly working on scaling its infrastructure to meet the demands of our ever-growing big data ecosystem. As the data grows in volume and richness, it becomes increasingly challenging for data...

  • high-level-system-architecture

    Fairness, Privacy, and Transparency by Design in AI/ML Systems

    July 26, 2019

    Co-authors: Stuart Ambler, Ahsan Chudhary, Mark Dietz, Sahin Cem Geyik, Krishnaram Kenthapadi, Ian Koeppe, Varun Mithal, Guillaume Saint-Jacques, Amir Sepehri, Thanh Tran, and Sriram Vasudevan Editor’s note: A shorter version of this article was originally posted by Krishnaram Kenthapadi on LinkedIn. Introduction How do we take fairness and transparency into...

  • cluster-illustration

    Detecting Interference: An A/B Test of A/B Tests

    June 5, 2019

    At LinkedIn, most decisions are made using experiments. When we want to decide between two features, we test them against each other in the real world: we give feature A to a random set of members, feature B to another set, and we compare the results. Are users of feature A more engaged? Do they have a better experience with our products? If so, feature A wins...

  • photo-of-divyakumar

    Getting to Know Divyakumar Menghani

    May 24, 2019

    LinkedIn wouldn't be the company it is today without the engineers who built it and the talented individuals in technical roles across...

  • machine-learning-workflow

    Driving Business Decisions Using Data Science and Machine...

    May 2, 2019

    Co-authors: Burcu Baran, Xiaojing Dong, Chi-Yi Kuan, Emily Huang, and Tiger Zhang   At LinkedIn, we have more than 630M members, 30M...

  • behind-big-data-and-ai-1

    Behind "Big Data" and "AI": Elements of Modern Data Science

    April 5, 2018

    I’m sure everyone who has been following tech industry news knows about “big data” and “AI.” Although there is no industry-consistent...