Hacker News new | past | comments | ask | show | jobs | submit login

There doesn't seem to be any evidence that it's used for indexing at all; it seems more like it's just used to scrape additional info from sites that they index via real search engines like Bing, Yandex, and Yahoo.


Guidelines | FAQ | Support | API | Security | Lists | Bookmarklet | Legal | Apply to YC | Contact