On: A/B testing gets misused to juice metrics in the short term

[londons_explore]

You can get long term results from AB tests long after the test has ended...

For example, you can see if Group A or Group B from a test are more likely to still use the site 1 year later.

You hypothesize that those ways to 'juice the metrics in the short term' hurt the user experience in the long term... Well if your hypothesis is right, these long term AB results should show it.

[epolanski → londons_explore]

> For example, you can see if Group A or Group B from a test are more likely to still use the site 1 year later.

This isn't very feasible on most products and certainly limited by the amount of data collected.