Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Recently I heard of a site blocking bot requests with a message telling the bot to download the site via Bittorrent instead.

Seems like a good solution to the badly behaved scrapers, and I feel like the web needs to move away from the client-server model towards a swarm model like Bittorrent anyway.



Even if these stupid bots would just learn to clone git repos instead of crawling through GitLab UI pages it would already be helpful.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: