Hacker News new | past | comments | ask | show | jobs | submit login

Is there any hope that if chat bots do actually become widespread in usage that eventually we'll be able to aggregate their collective knowledge similar to reinforcement learning for a single system? That seems like the only likely way we'll ever be able to train AI in something as complex as language.



The primary issue is that language doesn't have as well of a defined "success" metric. So more data doesn't necessarily make better language.

Without a human analyzing the transcripts it's very difficult for the chat bots to know which inputs it's receiving are "good" or "better."

Even the idea of good language is subjective. We all know there is such a thing, but nearly everyone has different ideas of what this is.


It depends on what the nature of language is. If it is purely a tool of consciousness, a separate module in mind like basic image recognition seems to be, then the picture you're painting may be possible. It may be that the language signal is strong enough to pick up just by looking at orders of magnitude more examples than we can right now. That we can crack the encryption, so to speak.

However, if language is more integral than that. If language is more a facet of intelligence than a building block. If language is the structure of sentience, rather than something sentience leverages, then no, all the chat bots in the world won't help. We need something that can integrate more than just plain text embeddings of incredibly intricate and complex structures. We can't crack this code without a key.

My guess is that this latter scenario is the likely case.




Registration is open for Startup School 2019. Classes start July 22nd.

Guidelines | FAQ | Support | API | Security | Lists | Bookmarklet | Legal | Apply to YC | Contact

Search: