Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Is the form for trials or paid customers? Seems the form is for trials which effects only the # of trials which was only marginally higher. What is the process to convert from trials to paid and is the video really the cause in the massive jump?

There were also other small subtle changes like the addition of "Request Instant Price Quote" headline etc.



Those small changes can be significant.

A/B tests need to be as specific to one adjustment as possible.

I've noticed flaws like this many times on ABtests.com. But I guess they are like any war stories, its the overall idea that counts not the details.


Appreciate the feedback. Would love to make our site better, any suggestions would be very much appreciated.

What are the primary flaws you're seeing?


I was referring to the accuracy of the test results on abtests.com in general not the site in the link. Many of the A/B examples had multiple changes to the site but only noted one as making a difference.

In your case adding a headline to the form was overlooked.

You were using form submissions as a metric from what I can tell. So changes specifically to the signup form itself (such as the header) is likely to have as much of an impact as the video.

Did you track how many people watched the video then signed up as a metric? That may be more telling.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: