On: Ask HN: What is your one tip about A/B testing you would share?

[mtmail]

If you radically change a feature then regular users will first start playing with it. Simply because it's new. In that case your test needs be longer or exclude regular users.