On: Why MongoDB is a bad choice for storing our scraped data

[shane42]

The problems with pagination are explained better on this SO post: http://stackoverflow.com/questions/7228169/slow-pagination-o... Mongo docs used the "walk" terminology