On: Google 5gram corpus has unreasonable 5grams

[Caligula]

I am glad to find out there are some other issues with it. My main disappointment with it however remains its license. It would of been really cool if Google released it with a CC or MIT license but instead its restricted for academic usage only. Better to spend time with other corpus'.

[steveitis → Caligula]

What other n-gram corpus' are there? I've been looking, and all I can seem to find is some web spammer trying to sell me one.

I don't particularly care about the license, but I'd rather not have to build my own spider to crawl and generate one for me.

[GFischer → steveitis]

Apparently Microsoft has one:

http://research.microsoft.com/apps/pubs/default.aspx?id=1307...

[donaldc → Caligula]

Better yet if they also released the corpus over bittorrent instead of requiring one spend $100+ for the cds. Let everyone play with it, not just full-time researchers.