Data & Analytics

What is A/B Testing?

Quick answer

Comparing two versions of a web page, email, or feature with different groups of users to see which performs better.

A/B Testing, explained

In an A/B test, users are randomly split into groups. One group sees the current version, called the control, and another sees a changed version. The team measures a chosen metric, such as sign-ups, purchases, or clicks, and uses statistics to judge whether any difference is likely to be real rather than chance.

For example, an online florist might test two checkout buttons, one labelled Buy now and one labelled Choose delivery date, and find that the second leads to more completed orders. A/B testing replaces guesswork with evidence. Good tests change one meaningful element at a time, decide the success metric in advance, run long enough to collect enough data, and avoid stopping early when results first look favourable.

Related terms

Guides that mention A/B Testing