machine learning Articles

  • diagram-showing-cycle-of-bias-reinforcement-over-time

    Using the LinkedIn Fairness Toolkit in large-scale AI systems

    February 8, 2021

    Co-authors: Preetam Nandy, Yunsong Meng, Cyrus DiCiccio, Heloise Logan, Amir Sepehri, Divya Venugopalan, Kinjal Basu, and Noureddine El Karoui Introduction LinkedIn’s vision to create economic opportunity for every member of the global workforce would be impossible to realize without leveraging AI at scale. We use AI in our core product offerings to: highlight...

  • gif-showing-smarg-arg-coding-in-action

    Smart Argument Suite: Seamlessly connecting Python jobs

    January 25, 2021

    Co-authors: Jun Jia and Alice Wu Introduction It’s a very common scenario that an AI solution involves composing different jobs, such as data processing and model training or evaluation, into workflows and then submitting them to an orchestration engine for execution. At large companies such as LinkedIn, there may be hundreds of thousands of such executions per...

  • open-sourcing-dagli-for-faster-and-easier-machine-learning

    Dagli: Faster and easier machine learning on the JVM, without the tech debt

    November 10, 2020

    In recent years, we’ve been fortunate to see a growing number of excellent machine learning tools, such as TensorFlow, PyTorch, DeepLearning4J, and CNTK for neural networks, Spark and Kubeflow for very-large-scale pipelines, and scikit-learn, ML.NET, and the recent Tribuo for a wide variety of common models. However, models are typically part of an integrated...

  • pensieve-an-embedding-feature-platform

    Pensieve: An embedding feature platform

    October 14, 2020

    Co-authors: Benjamin Le, Daniel Gmach, Aman Grover, Roshan Lal, Jerry Lin, Austin Lu, Qingyun Wan, and Leighton Zhang Feature...

  • sketching-out-what-a-heterogeneous-social-network-looks-like

    Building a heterogeneous social network recommendation...

    October 6, 2020

    Co-authors: Parag Agrawal, Ankan Saha, Yafei Wang, Aastha Nigam, and Eric Lawrence Figure 1: A heterogeneous social network LinkedIn’s...

  • gdmix-logo

    GDMix: A deep ranking personalization framework

    September 29, 2020

    Our logo is inspired by the chameleon: You can enable personalization on your ranking model with GDMix, bringing a personalized...