IA should start respecting robots.txt disallow, because right now they ignore it... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

PatrolX on June 2, 2020 | parent | context | favorite | on: Publishers File Suit Against Internet Archive

IA should start respecting robots.txt disallow, because right now they ignore it.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact