What's really interesting to me is that this approach yields state-of-the-art chatbot results, significantly outperforming other, non-ensemble approaches.
It makes me wonder if the subconscious part of the human mind does something similar, i.e., when faced with the task of articulating a response, does the brain subconsciously evaluate a range of possible responses, each generated by different subsystems, and then choose the best of these responses or some mixture of them, to respond?
Compare it to how a human chess player looks at several possible moves as opposed to a computer program which will consider thousands.
And papers the provide code often do not provide enough or the correct code to replicate the paper. Looking at you, XNOR-Net
Maybe we need more time but chatbots got hyped for too long without any significant traction. Most are web shops/ agencies that build mediocre chatbots for brands nobody is using.
Not bashing chatbots just wondering why this topic gets upvoted again and again.
Because most chatbots are crap (for real world applications) because chatting is a hard problem but there's a great potential?