way to go matt. Did you say 1.5G? For those reading & who want a summary the problem is on 'entity resolution'.
'... A common problem that we face is that there are many people with the same name. Given that, how do we distinguish a document about Michael Jackson the singer from Michael Jackson the football player ...'
Yes, 1.5G. And that's just the small dataset to get you going! They really should used a Torrent for this thing. Right now I'm hoping my wireless keeps up with the download.
There are times when you want to keep things in your house. They're using amazon s3 so it's costing them $0.30 per download. Pennies compared to the 50k prize.
'... A common problem that we face is that there are many people with the same name. Given that, how do we distinguish a document about Michael Jackson the singer from Michael Jackson the football player ...'