On: Ask HN: AI bots everywhere – does anyone have a good whitelist for robots.txt?

[zaphodias]

> is a right

I believe they're saying that cloudflare will block them just for using a blacklisted client, even if they're legit users and not bots

[userbinator → zaphodias]

Not even that; it's a whitelist, not a blacklist, and the only clients whitelisted are essentially those of Big Browser.