Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
ithkuil
on Jan 11, 2013
|
parent
|
context
|
favorite
| on:
Wayback Machine: Now with 240,000,000,000 URLs
A possible pragmatic solution would be to track the site and spot ownership changes and freeze the robots.txt when it happens.
Reliable ownership change detection can be tricky though, but it's doable IMHO.
Consider applying for YC's Winter 2027 batch!
Applications
are open till November 2.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
Reliable ownership change detection can be tricky though, but it's doable IMHO.