To zero in on your last question, I do think a very good LLM can surface the unconscious (even completely unstated or hitherto nonexistent) "connecting thread" linking two subjective thoughts and make them explicitly known. And so what if they were not something either of us had in mind?
Surely the ability to do that is worth taking note of.
I am not advocating for letting LLM's write for you, to be clear. Sentiment wise, I largely agree with you. Just not with your total writing off of the possibility that it could serve.
It's easy to imagine an LLM aiding the communication between a mentally disabled person and their parent/caretaker.
Or, perhaps, some day, between animal and man. Who cares if the mediating component "hallucinates" some particulars of expression if it achieves the goals both want, which were previously impossible?
Surely the ability to do that is worth taking note of.
I am not advocating for letting LLM's write for you, to be clear. Sentiment wise, I largely agree with you. Just not with your total writing off of the possibility that it could serve.
It's easy to imagine an LLM aiding the communication between a mentally disabled person and their parent/caretaker.
Or, perhaps, some day, between animal and man. Who cares if the mediating component "hallucinates" some particulars of expression if it achieves the goals both want, which were previously impossible?