Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
fallentimes
on Aug 28, 2008
|
parent
|
context
|
favorite
| on:
Backtype (YC summer 08): Twitter for comments laun...
Robot.txt file. You can tell Google to do the same thing.
briansmith
on Aug 28, 2008
[–]
Only the site owner can use Robots.txt. The commenter cannot control it.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: