LLMs emulate human communication really well and, no doubt, one day they'll do it perfectly. But is an emulator the real thing? Obviously not.
If I wire some electrodes in your tongue perfectly so you can feel each flavor exactly as it is in real life, is that the same thing as eating the real thing? Again, it's not.
Let's stay you're asleep. You have a dream in which you interact with a person that talks to you. Is that oneiric entity conscious? Nope.
I'm even steelmanning your argument by assuming LLMs are as good as humans already, which they're not.
How do you know the other humans you interact with in real life are conscious? They might be biological automatons, golems. You will never know. It's not something that can ever be proven. Only human empathy allows anyone to believe otherwise.
You know you're conscious because your soul is staring out at the world through your eyes. Generalizing from your own experience and concluding that other humans are conscious is a logical jump, a spiritual belief. Humans even extend it to animals. There is no reason why it can't be extended to AIs.
LLMs emulate human communication really well and, no doubt, one day they'll do it perfectly. But is an emulator the real thing? Obviously not.
If I wire some electrodes in your tongue perfectly so you can feel each flavor exactly as it is in real life, is that the same thing as eating the real thing? Again, it's not.
Let's stay you're asleep. You have a dream in which you interact with a person that talks to you. Is that oneiric entity conscious? Nope.
I'm even steelmanning your argument by assuming LLMs are as good as humans already, which they're not.