Clik here to view.
Preceden A/B Test Results: Apparently Folks Don’t Like Gradients
I’ve been running an A/B test on Preceden, my web-based timeline maker, for the last week to test the impact of gradient bars on the sign up rate. Half the people saw solid color bars: And half the...
View ArticleClik here to view.
Plotting a Normal Distribution with R
I’ve been tinkering around with R for learning more about the math behind A/B testing and figured I’d share some of the work as I go. The website Stat Methods has an example showing how to plot a...
View ArticleClik here to view.
Rendering Two Normal Distribution Curves on a Single Plot with R
As a follow-up to my last post about how to render a normal distribution curve with R, here’s how you can render two on the same plot: setClass( Class = "Distribution", representation = representation(...
View ArticleClik here to view.
Visualizing How a Normal Distribution Approximates a Binomial Distribution...
My handy Elementary Statistics textbook, which I’m using to get smart on the math behind A/B testing, states the following: Normal Distribution as Approximation to Binomial Distribution If and , then...
View ArticleClik here to view.
Visualizing the Sampling Distribution of a Proportion with R
In yesterday’s post, we showed that a binomial distribution can be approximated by a normal distribution and some of the math behind it. Today we’ll take it a step further, showing how those results...
View ArticleClik here to view.
How Calypso’s A/B Test Module Works
Automattic recently open sourced Calypso, a JavaScript and REST-API powered interface that runs WordPress.com. I was fortunate to get to work on a few pieces of it, mainly its Analytics and A/B Test...
View ArticleClik here to view.
How would an evolving website work?
As a web developer who is also interested in A/B testing and evolution, it occurred to me that it would be fascinating to try to build a website that optimizes itself. I’ve been kicking around this...
View ArticleClik here to view.
Anyone interested in collaborating on an A/B test simulator?
I recently started working on a small side project to build an A/B test simulator. My goal is to measure the long term conversion rate impact of different approaches such as: What impact do various...
View ArticleClik here to view.
Analyzing an A/B Test’s Impact Using Funnel Segmentation
If you decide to roll your own in-house A/B testing solution, you’re going to need a way to measure how each variation in each test influences user behavior. In my experience the best way to do this is...
View ArticleClik here to view.
A/B Test Simulator v1
A few weeks ago I wrote about how I was working on an A/B test simulator and asked if anyone was interested in working on it. A few of you reached out (thank you!) but the discussions quickly stalled...
View Article