I wrote a basic Craigslist scraper earlier this month to show some statistics about the rental markets in different regions/neighborhoods so I'm eager to check this out.[0]
Just out of curiosity, what is the purpose of this? Perhaps for setting up a secondary market with items from Craigslist?
Be careful when using this - violates the CL TOS[0] and they've been known to sue people who scrape their system[1].
Relevant excerpt from TOS:
“Any copying, aggregation, display, distribution, performance or derivative use of Craigslist or any content posted on Craigslist whether done directly or through intermediaries (including but not limited to by means of spiders, robots, crawlers, scrapers, framing, iframes or RSS feeds) is prohibited.”
But this example only for research purposes, and gathered data will only stored for short time and without publication, personal information of users are not gathered.
Just out of curiosity, what is the purpose of this? Perhaps for setting up a secondary market with items from Craigslist?
[0]: https://github.com/brbsix/craigslist-rental-market