1. Monitor online ad distribution
2. Build directories of people on the web
3. Check for IP violoations (digital watermarking, etc.)
4. Build niche, localized search engines (picture searching, regional searching, etc.)
5. Collect information on product pricing, retail data, etc.
Crawling gets a bad rap. It's useful for a bunch of stuff.
1. Monitor online ad distribution
2. Build directories of people on the web
3. Check for IP violoations (digital watermarking, etc.)
4. Build niche, localized search engines (picture searching, regional searching, etc.)
5. Collect information on product pricing, retail data, etc.
Crawling gets a bad rap. It's useful for a bunch of stuff.