BA Toolkit / Frameworks & methods
A/B Testing
Testing two versions to see which performs better.
What it is
A/B testing shows two versions of something, such as a page, email or feature, to similar groups of users and measures which one performs better against a chosen metric.
How a Business Analyst uses it
- Turn opinions into a testable hypothesis
- Define the success metric and sample size before the test starts
- Analyse results and check they’re statistically significant
- Recommend which version to roll out, backed by evidence
Practical tip
Decide the metric before you look at the results. Otherwise you’ll find a winner by accident.
Where I've used it
At Host My Code I ran A/B tests on 50+ marketing creatives, which lifted click-through rates 2.1x.
Related tools
Need a Business Analyst who knows these tools?
I use these tools to turn business problems into clear requirements and measurable results.