A/B Testing Articles

  • building-inclusive-products-through-a-b-testing

    Building inclusive products through A/B testing

    March 31, 2020

    Co-authors: Guillaume Saint-Jacques, Amir Sepehri, Nicole Li, and Igor Perisic Introduction Previously on this blog, we’ve shared information on best practices in data science, particularly in areas such as A/B testing. We’ve also discussed the importance of ethics in fields such as data science, early implementations of “fairness by design” principles in our...

  • diagram-of-linkedin-services-and-the-lix-engine

    Making the LinkedIn experimentation engine 20x faster

    January 3, 2020

    Co-authors: Alexander Ivaniuk, Jingbang Liu At LinkedIn, we like to say that experimentation is in our blood because no production release at the company happens without experimentation; by “experimentation,” we typically mean “A/B testing.” The company relies on employees to make decisions by analyzing data. Experimentation is a data-driven foundation of the...

  • cluster-illustration

    Detecting Interference: An A/B Test of A/B Tests

    June 5, 2019

    At LinkedIn, most decisions are made using experiments. When we want to decide between two features, we test them against each other in the real world: we give feature A to a random set of members, feature B to another set, and we compare the results. Are users of feature A more engaged? Do they have a better experience with our products? If so, feature A wins...

  • sitespeedAB1

    Site Speed Monitoring in A/B Testing and Feature Ramp-up

    June 21, 2017

    Co-authors: Jiahui Qi and David He   Everyday, LinkedIn serves hundreds of millions of pageviews to our members, from job searches to...

  • XLNT Team

    Are the Best Decisions Instinctual, or Data-Driven?

    November 12, 2015

    How do you develop products? Do you blindly trust your instinct, or do you hide behind a mountain of data to make decisions? Sure,...

  • Top Five Lessons from Running A/B Tests on the World's...

    November 10, 2015

    We run thousands of experiments each year at LinkedIn. Thousands of features, big and small, have been launched, refined, or discarded...