ddg actually has its own crawler and does a *tiny* amount of its own indexing. I... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		culi 37 days ago \| parent \| context \| favorite \| on: Google Removed 749M Anna's Archive URLs from Its S... ddg actually has its own crawler and does a tiny amount of its own indexing. It used to do more but resorted to just mostly using Bing and Yandex indexes

yegg 37 days ago [–]

We have actually started doing a lot more crawling and indexing in the last 24 months.

n1xis10t 33 days ago | [–]

Oh really? That’s cool, how much have you crawled so far?

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact