Hacker News new | past | comments | ask | show | jobs | submit login
A guide to Web scraping without getting blocked (scrapingninja.co)
7 points by ksahin 83 days ago | hide | past | web | favorite | 1 comment

While I don't think scrapers have legal action taken against them unless they become a major pain for the company, faking User-Agent strings has been painted as spoofing by lawyers, https://stackoverflow.com/a/20926119/9044659 (very old example).

I wonder if employing these methods worsen the legality (or the lack of it thereof) associated with scraping.

Guidelines | FAQ | Support | API | Security | Lists | Bookmarklet | Legal | Apply to YC | Contact