On: Mixnode: Turn the web into a database

[samat]

There is a product (several of them from one company, actually) for crawling, but it's more of a tooling than a end-user product https://scrapinghub.com