BA Toolkit / Frameworks & methods

A/B Testing

Testing two versions to see which performs better.

What it is

A/B testing shows two versions of something, such as a page, email or feature, to similar groups of users and measures which one performs better against a chosen metric.

How a Business Analyst uses it

  • Turn opinions into a testable hypothesis
  • Define the success metric and sample size before the test starts
  • Analyse results and check they’re statistically significant
  • Recommend which version to roll out, backed by evidence

Practical tip

Decide the metric before you look at the results. Otherwise you’ll find a winner by accident.

Where I've used it

At Host My Code I ran A/B tests on 50+ marketing creatives, which lifted click-through rates 2.1x.

Related tools

← Back to the full toolkit

Need a Business Analyst who knows these tools?

I use these tools to turn business problems into clear requirements and measurable results.

Scroll to Top