A/B Testing Articles

  • illustration-of-budget-divided-among-groups

    Budget-split testing: A trustworthy and powerful approach to marketplace A/B testing

    January 21, 2021

    Co-authors: Min Liu, Vangelis Dimopoulos, Elise Georis, Jialiang Mao, Di Luo, and Kang Kang The LinkedIn ecosystem drives member and customer value through a series of marketplaces (e.g., the ads marketplace, the talent marketplace, etc.). We maximize that value by making data-informed product decisions via A/B testing. Traditional A/B tests on our marketplaces,...

  • diagram-for-variant-assignment-for-a-sample-population

    A/B testing at LinkedIn: Assigning variants at scale

    December 16, 2020

    Co-authors: Alexander Ivaniuk and Weitao Duan Editor’s note: This blog post is the second in a series providing an overview and history of LinkedIn’s experimentation platform. The previous post on the history of LinkedIn’s experimentation infrastructure can be found here. Introducing variant assignment Previously on the blog, we’ve shared a look into how...

  • test-management-deployment-and-evaluation-workflow-at-linkedin

    Our evolution towards T-REX: The prehistory of experimentation infrastructure at LinkedIn

    September 24, 2020

    Editor’s note: This blog post is the first in a series providing an overview and history of LinkedIn’s experimentation platform. At any given time, LinkedIn’s experimentation platform is serving up to 41,000 A/B tests simultaneously on a user population of over 700 million members. Operation at such a scale is enabled with the LinkedIn Targeting, Ramping, and...

  • diagram-showing-the-architecture-of-identity-services

    How we reduced latency and cost-to-serve by merging two...

    April 22, 2020

    Co-authors: Xiang Zhang, Estella Pham, and Ke Wu Identity services are critical systems that serve data on profile and member settings...

  • metadata-library-updates

    Rapid experimentation through standardization: Typed AI...

    April 15, 2020

    Serving the most relevant information for LinkedIn members in the homepage feed requires a massive effort—hundreds of features are...

  • building-inclusive-products-through-a-b-testing

    Building inclusive products through A/B testing

    March 31, 2020

    Co-authors: Guillaume Saint-Jacques, Amir Sepehri, Nicole Li, and Igor Perisic Introduction Previously on this blog, we’ve shared...