experimentation Articles

  • illustration-of-budget-divided-among-groups

    Budget-split testing: A trustworthy and powerful approach to marketplace A/B testing

    January 21, 2021

    Co-authors: Min Liu, Vangelis Dimopoulos, Elise Georis, Jialiang Mao, Di Luo, and Kang Kang The LinkedIn ecosystem drives member and customer value through a series of marketplaces (e.g., the ads marketplace, the talent marketplace, etc.). We maximize that value by making data-informed product decisions via A/B testing. Traditional A/B tests on our marketplaces,...

  • test-management-deployment-and-evaluation-workflow-at-linkedin

    Our evolution towards T-REX: The prehistory of experimentation infrastructure at LinkedIn

    September 24, 2020

    Editor’s note: This blog post is the first in a series providing an overview and history of LinkedIn’s experimentation platform. At any given time, LinkedIn’s experimentation platform is serving up to 41,000 A/B tests simultaneously on a user population of over 700 million members. Operation at such a scale is enabled with the LinkedIn Targeting, Ramping, and...

  • open-sourcing-our-spark-inequality-a-b-testing-library

    Bringing Project Every Member to life: Open sourcing our Spark inequality A/B testing library

    May 26, 2020

    Co-authors: Guillaume Saint-Jacques, Stuart Ambler Last month on this blog, we introduced how we are building inclusive products through A/B testing, something we internally call Project Every Member, and discussed the novel application of inequality A/B testing using the Atkinson index and the use of this technique in the product design process at LinkedIn....

  • diagram-showing-the-architecture-of-identity-services

    How we reduced latency and cost-to-serve by merging two...

    April 22, 2020

    Co-authors: Xiang Zhang, Estella Pham, and Ke Wu Identity services are critical systems that serve data on profile and member settings...

  • metadata-library-updates

    Rapid experimentation through standardization: Typed AI...

    April 15, 2020

    Serving the most relevant information for LinkedIn members in the homepage feed requires a massive effort—hundreds of features are...

  • building-inclusive-products-through-a-b-testing

    Building inclusive products through A/B testing

    March 31, 2020

    Co-authors: Guillaume Saint-Jacques, Amir Sepehri, Nicole Li, and Igor Perisic Introduction Previously on this blog, we’ve shared...