Before we get too far, what is A/B testing? Well, it is the testing of element but done in two different ways. This element can consist of the layout of the page, a button on the page, the wording, and just about anything that can be changed. A/B testing can cause a huge impact on your digital marketing.
Smashing Magazine layed out some do’s and dont’s for us to follow when doing A/B testing:
Do’s-
Know when A/B testing has run it’s course. Don’t cut it short too soon or let it run too long, because that can really cost you.
Always show repeat visitors the same variation.
Don’t just change the element in one place, but across an entire website. So if you are changing the color of something, don’t just change it on the homepage.
Do an A/B/C/D/E test. Don’t just stick to A/B testing.
Don’ts
Don’t wait to start A/B testing till control is done. Test simultaneously.
Don’t start interpreting to early. Your testing may not be done.
Surprising consistent visitors can be bad. Set up testing for new visitors only.
Gut doesn’t tell you everything. Look at test results.
Master of A/B Testing
Let’s talk about Obama. No, I’m not going to get into my political views, but I do want to talk about his campaign. If you have a chance watch the video above, because it really breaks down the way the Obama campaign rocked A/B testing out of this world. I have included a few pictures that show how he used A/B testing during his campaign. He was extremely successful with A/B testing and was able to reach such a large audience with his message do to it. Did you know that the Obama campaign performed “500 A/B tests during a 20 month period increased donation conversions by 49% and sign up conversions by 161%” (Kyle Rush Blog). If you are really interested in seeing exactly how they did this, check out the website Nathaniel Ward article, where he breaks down one ad that was done 13 different ways.
If you don’t happen to watch the video above, he breaks down the process the Obama campaign used when A/B testing:
- Identifying Goals
- Hypotheses
- Create Experiments
- Prioritize with ROI
- Test
- Record Results
Digital Marketing Is Awesome
Digital Marketing opens up a whole new world. It not only easier and quick, but it is all trackable. You can really find out who is seeing your ads and all sorts of demographics.
Sources:
Smashing Magazine: The Ultimate Guide to A/B Testing
Kyle Rush Blog: Optimization at the Obama Campaign: A/B testing
Nathaniel Ward Blog: See A/B Testing in Action on Barack Obama’s Re-Election Website
Practical Guide to Controlled Experiments on the Web: Listen to Your Customer not the HiPPO