A/B Testing Articles

  • diagram-of-linkedin-services-and-the-lix-engine

    Making the LinkedIn experimentation engine 20x faster

    January 3, 2020

    Co-authors: Alexander Ivaniuk, Jingbang Liu At LinkedIn, we like to say that experimentation is in our blood because no production release at the company happens without experimentation; by “experimentation,” we typically mean “A/B testing.” The company relies on employees to make decisions by analyzing data. Experimentation is a data-driven foundation of the...

  • cluster-illustration

    Detecting Interference: An A/B Test of A/B Tests

    June 5, 2019

    At LinkedIn, most decisions are made using experiments. When we want to decide between two features, we test them against each other in the real world: we give feature A to a random set of members, feature B to another set, and we compare the results. Are users of feature A more engaged? Do they have a better experience with our products? If so, feature A wins...

  • sitespeedAB1

    Site Speed Monitoring in A/B Testing and Feature Ramp-up

    June 21, 2017

    Co-authors: Jiahui Qi and David He   Everyday, LinkedIn serves hundreds of millions of pageviews to our members, from job searches to the news feed. Our network has grown to over 500 million members, and throughout our journey, “members-first” has been a fundamental value that we’ve carried. For our mission to continue improving the member experience, LinkedIn’s...

  • XLNT Team

    Are the Best Decisions Instinctual, or Data-Driven?

    November 12, 2015

    How do you develop products? Do you blindly trust your instinct, or do you hide behind a mountain of data to make decisions? Sure,...

  • Top Five Lessons from Running A/B Tests on the World's...

    November 10, 2015

    We run thousands of experiments each year at LinkedIn. Thousands of features, big and small, have been launched, refined, or discarded...

  • LinkedIn Groups Digest Email

    How Experimentation Helped LinkedIn Improve Email...

    October 28, 2015

    This is the second in a two-part series about how LinkedIn’s different business units use A/B testing and XLNT, our A/B testing...