experimentation Articles

  • Our Approach to Research and A/B Testing

    December 7, 2022

    We are constantly striving to improve the experience on LinkedIn for our members and customers, with research and experimentation, such as A/B Testing, playing a key role in that work. Nearly a decade ago, I discussed the importance of these techniques in our journey to create economic opportunity for every member of the global workforce. Today we have a strong...

  • illustration-of-budget-divided-among-groups

    Budget-split testing: A trustworthy and powerful approach to marketplace A/B testing

    January 21, 2021

    Co-authors: Min Liu, Vangelis Dimopoulos, Elise Georis, Jialiang Mao, Di Luo, and Kang Kang The LinkedIn ecosystem drives member and customer value through a series of marketplaces (e.g., the ads marketplace, the talent marketplace, etc.). We maximize that value by making data-informed product decisions via A/B testing. Traditional A/B tests on our marketplaces,...

  • test-management-deployment-and-evaluation-workflow-at-linkedin

    Our evolution towards T-REX: The prehistory of experimentation infrastructure at LinkedIn

    September 24, 2020

    Editor’s note: This blog post is the first in a series providing an overview and history of LinkedIn’s experimentation platform. At any given time, LinkedIn’s experimentation platform is serving up to 41,000 A/B tests simultaneously on a user population of over 700 million members. Operation at such a scale is enabled with the LinkedIn Targeting, Ramping, and...

  • open-sourcing-our-spark-inequality-a-b-testing-library

    Bringing Project Every Member to life: Open sourcing our...

    May 26, 2020

    Co-authors: Guillaume Saint-Jacques, Stuart Ambler Last month on this blog, we introduced how we are building inclusive products...

  • diagram-showing-the-architecture-of-identity-services

    How we reduced latency and cost-to-serve by merging two...

    April 22, 2020

    Co-authors: Xiang Zhang, Estella Pham, and Ke Wu Identity services are critical systems that serve data on profile and member settings...

  • metadata-library-updates

    Rapid experimentation through standardization: Typed AI...

    April 15, 2020

    Serving the most relevant information for LinkedIn members in the homepage feed requires a massive effort—hundreds of features are...