How are A/B tests for non-logged-in users doing these days with all the cookie b... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

quickthrower2 on Sept 14, 2023 | parent | context | favorite | on: Statistical significance on a shoestring budget

How are A/B tests for non-logged-in users doing these days with all the cookie banners, privacy and ad blockers etc. Is this stuff still working even?

AlexeyMK on Sept 14, 2023 [–]

Yes, but it is _rough_. What actually hurts is "browse on mobile, buy on desktop" type behavior.

Still worth doing, but you end up needing more black magic than you'd like (IP-based assignment, Ad Network-sourced assignment, CDN proxies for Analytics tools, etc).

Working on a separate post about that.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact