Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

All traffic includes stylesheets, JS, images and so on that your typical browser will faithfully retrieve to render a page but most bots or scrapers will ignore some or all of them.
 help



That aligns with what I observed. Real people using HTTP/2.0 will pull my style-sheet and the bots just request the document I link here on HN.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: