Its a very single purpose system, so probably not amenable to general purpose cr...

jalfresi on Dec 23, 2014 | parent | context | favorite | on: Show HN: Scrape the web by injecting JavaScript in...

Its a very single purpose system, so probably not amenable to general purpose crawling (though we do have a separate system that is based of the design of our core system that is a general purpose web crawler/indexer)