Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

If a company has no terms of use or any other kind of policy on their site, what are the issues in scraping the content? any way to prevent it?


You always have a copyright, even if you don't say so on the page.

They could of course add a robots.txt and stop nicely behaved scrapers that way, but to stop all scraping is impossible. There's always a way. The best you can hope for is to make it so hard, that they don't bother creating a custom made scraper.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: