Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Robot.txt file. You can tell Google to do the same thing.


Only the site owner can use Robots.txt. The commenter cannot control it.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: