Ask HN: Is scraping webpages for research purposes considered legal | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

		Ask HN: Is scraping webpages for research purposes considered legal
		1 point by fantasticwaddle on July 5, 2018 \| hide \| past \| favorite \| 3 comments

viraptor on July 5, 2018 | [–]

Depends on a country. And in practice on how much money the people behind the website can throw at the lawyers when annoyed.

For the US you may want to read about https://en.wikipedia.org/wiki/Aaron_Swartz

Petrakis on July 5, 2018 | | [–]

Also depends on the ToS of each page, and their robots.txt should allow or disallow crawling

brudgers on July 5, 2018 | [–]

If it matters pay a lawyer for a legal opinion. If it doesn't matter, it doesn't matter. Good luck.

Join us for AI Startup School this June 16-17 in San Francisco!
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact