Quantcast
Channel: A/B Tests – Matt Mazur
Browsing latest articles
Browse All 10 View Live

Image may be NSFW.
Clik here to view.

Preceden A/B Test Results: Apparently Folks Don’t Like Gradients

I’ve been running an A/B test on Preceden, my web-based timeline maker, for the last week to test the impact of gradient bars on the sign up rate. Half the people saw solid color bars: And half the...

View Article



Image may be NSFW.
Clik here to view.

Plotting a Normal Distribution with R

I’ve been tinkering around with R for learning more about the math behind A/B testing and figured I’d share some of the work as I go. The website Stat Methods has an example showing how to plot a...

View Article

Image may be NSFW.
Clik here to view.

Rendering Two Normal Distribution Curves on a Single Plot with R

As a follow-up to my last post about how to render a normal distribution curve with R, here’s how you can render two on the same plot: setClass( Class = "Distribution", representation = representation(...

View Article

Image may be NSFW.
Clik here to view.

Visualizing How a Normal Distribution Approximates a Binomial Distribution...

My handy Elementary Statistics textbook, which I’m using to get smart on the math behind A/B testing, states the following: Normal Distribution as Approximation to Binomial Distribution If and , then...

View Article

Image may be NSFW.
Clik here to view.

Visualizing the Sampling Distribution of a Proportion with R

In yesterday’s post, we showed that a binomial distribution can be approximated by a normal distribution and some of the math behind it. Today we’ll take it a step further, showing how those results...

View Article


Image may be NSFW.
Clik here to view.

How Calypso’s A/B Test Module Works

Automattic recently open sourced Calypso, a JavaScript and REST-API powered interface that runs WordPress.com. I was fortunate to get to work on a few pieces of it, mainly its Analytics and A/B Test...

View Article

Image may be NSFW.
Clik here to view.

How would an evolving website work?

As a web developer who is also interested in A/B testing and evolution, it occurred to me that it would be fascinating to try to build a website that optimizes itself. I’ve been kicking around this...

View Article

Image may be NSFW.
Clik here to view.

Anyone interested in collaborating on an A/B test simulator?

I recently started working on a small side project to build an A/B test simulator. My goal is to measure the long term conversion rate impact of different approaches such as: What impact do various...

View Article


Image may be NSFW.
Clik here to view.

Analyzing an A/B Test’s Impact Using Funnel Segmentation

If you decide to roll your own in-house A/B testing solution, you’re going to need a way to measure how each variation in each test influences user behavior. In my experience the best way to do this is...

View Article


Image may be NSFW.
Clik here to view.

A/B Test Simulator v1

A few weeks ago I wrote about how I was working on an A/B test simulator and asked if anyone was interested in working on it. A few of you reached out (thank you!) but the discussions quickly stalled...

View Article
Browsing latest articles
Browse All 10 View Live




Latest Images