Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
Venn1
52 days ago
|
parent
|
context
|
favorite
| on:
AI crawlers need to be more respectful
I blocked Microsoft/OpenAI a few weeks ago for (semi) childish reasons. Seven months later, Bing still refuses to index my blog, despite scraping it daily. The AI scrapers and crawlers toggle on Cloudflare did the trick.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
