On: A dataset of every Reddit comment

[bl4ckdu5t]

If it's open source I'll love to take a look

[Houshalter → bl4ckdu5t]

I pastebined the code. It's terrible. I should rewrite it. But here it is: http://pastebin.com/CM9u17jq

[jetpm → Houshalter]

Nice, I see you use neural networks, can you explain a bit how you are training them?

[Houshalter → jetpm]

It searches reddit for whatever the user queries. Reddit returns up to 100 threads. I then choose a thread and take the top comment.

The neural network predicts which thread is most likely to produce a satisfying answer. The main features are number of n-gram matches with the question, the score, the number of comments, and some other metadata.

It's far from optimal but it does improve it a bit.