Hacker News new | past | comments | ask | show | jobs | submit login

I found their website, and a page describing the service I believe these police are using. https://www.erad-group.com/fci

Also, I noticed that site:www.erad-group.com doesn't return anything on google, but it does on other search engines. Did ERAD request that it be removed from search results? Why would they do that? Why would they also not have a robots.txt if that is the case?

From their html source:

  <meta name="robots" content="noindex" />
  <meta name="ROBOTS" content="NOINDEX, FOLLOW" />
  <meta name="ROBOTS" content="INDEX, NOFOLLOW" />
  <meta name="ROBOTS" content="NOINDEX, NOFOLLOW" />
Not sure what they are intending here. But my guess is they don't either.

[edit: submitted too soon by mistake]

I think they mean that case-sensitive crawlers are disallowed, and they reserve the right to arbitrarily sue case-insensitive crawlers under the CFAA.

Guidelines | FAQ | Support | API | Security | Lists | Bookmarklet | Legal | Apply to YC | Contact