A/B Testing Resources

I am indebted to the following two articles for influencing the design of A/Bingo:

• Practical Guide to Controlled Experiments on the Web
• This quick refresher on high school statistics, which reminded me how to calculate Z-scores.

I would also like to thank Eric Ries from IMVU for his continued evangelization of split testing. In particular, his emphasis that people will only actually use split testing if it is accomplishable in one line of code became one of my guiding lights for the project. A/Bingo treats programmer productivity as a goal subordinate only to the customer experience.

Acknowledgements

In no particular order:

• "St. Joe" Bettina, for teaching me statistics and, more importantly, for teaching me to love them.
• The Business of Software and SEOBook forums, for teaching me most of what I know about marketing.
• The Hacker News community, for giving me the motivation to write code and write about code that would otherwise never see the light of day.
• The authors of the 72 (and counting) OSS packages used in the creation of Bingo Card Creator.
• The 2600 customers of Bingo Card Creator.
• My day job, for putting up with the quirky American's extracurricular hobby, even when he came in bleary eyed for a week because he was up until 4 AM coding.

• A/Bingo Home
• Get The Code
• Install (< 5 minutes)
• Usage
• FAQ
• A/Bingo vs. Alternatives
• A/B Testing Resources & Acknowledgments

For added fun, you can see some real A/B test results I've collected from Bingo Card Creator, with commentary.

I've also written some A/B testing design documents, in case you want to write your own framework. Try it: it is fun, educational, and pays very well.