I'm asking because a lot of people have only tried the 3.5 model and then lose interest when it fails on stupid ways. GPT-4 is not just quantitatively better, it's a qualitative jump ahead. Just in case you haven't tried it out yet (which I assume given your comment since gpt-4 gets that answer right) I encourage you to do it
It's not perfect and the classic failure modes of LLMs (the one you mentioned and others) are still present, but to a much much smaller degree.
I have a few prompts I use for specific tasks, where I ask it to answer tersely and it sometimes says so when something is impossible. Sometimes it hallucinates an answer. The likelihood for it to not hallucinate an answer seems to be proportional to desired terseness of the answer, as if the default instruction to "be helpful" biases it towards telling you something, anything
I'm asking because a lot of people have only tried the 3.5 model and then lose interest when it fails on stupid ways. GPT-4 is not just quantitatively better, it's a qualitative jump ahead. Just in case you haven't tried it out yet (which I assume given your comment since gpt-4 gets that answer right) I encourage you to do it