Split Testing Results for Bingo Card Creator

This page displays automatically recorded A/B testing results for Bingo Card Creator. Some of them I thought were interesting enough to do a little mini-writeup for. The other ones are minor tweaks or failed experiments. I mostly keep them here a) to have a convenient interface to check on my tests-in-progress and b) to remind folks that most A/B tests fail. That's the entire point of A/B testing: failing your way forward.

Stats geeks: All stats are delayed by up to 24 hours. If you have a burning urge to see the numbers, mouse over any percentage on this page and it will show you how it was calculated.

Sign Up Page Banner: On Theme or Not?

I have a page which hawks a Halloween bingo activity that has a graphical design distinct from that of this site. I tested the control signup page, which uses this site's branding, against an alternative which uses elements of the mini-site branding to reassure users that they are in the same place.

Desired conversion: A free trial sign-up
Results:
Halloween header: 34.44% winner
Standard header: 32.49%
Significance: Not significant

A/B Test Results (Live)

A/B Test Results (Completed)

• A/Bingo Home
• Get The Code
• Install (< 5 minutes)
• Usage
• FAQ
• A/Bingo vs. Alternatives
• A/B Testing Resources & Acknowledgments

For added fun, you can see some real A/B test results I've collected from Bingo Card Creator, with commentary.

I've also written some A/B testing design documents, in case you want to write your own framework. Try it: it is fun, educational, and pays very well.