That's an argument for ChatGPT not being able to do anything a la, "ChatGPT cannot create text because it doesn't understand text," or ChatGPT cannot predict the next word because it doesn't know what words are."
The problem is that it's as powerful a statement as "ChatGPT can't do X because ChatGPT can't do X," which is tautological true.
It's fine that it can't but we don't have epistemological access to know if ChatGPT knows something or not.
The problem is that it's as powerful a statement as "ChatGPT can't do X because ChatGPT can't do X," which is tautological true.
It's fine that it can't but we don't have epistemological access to know if ChatGPT knows something or not.