CRM glossary
A/B test
Also called: split test, champion challenger
An A/B test splits an audience at random between two or more versions of a message and compares the outcome that matters. It is the only dependable way to tell whether a subject line, offer or send time changed behaviour rather than simply coincided with it. Most email tests fail on sample size rather than idea quality: a modest list with a low conversion rate can need far more recipients than one send provides, so work out the sample you need before writing the variant.
Articles using this term · 6
- A testing cadence that survives a busy quarter · 18 August 2026
- The decision log that stops two years of tests evaporating · 18 December 2025
- Send-time optimisation: signal or noise · 20 October 2025
- Keeping brand voice when a model writes the first draft · 21 August 2025
- Holdout groups, or you cannot prove CRM works · 5 June 2025
- Life after the open rate · 22 June 2024