Well, I mean it’s pretty fair accusation. ChatGPT was demonstrably bad at math. I think it was only recently mentioned that GPT4 was trained on math. Furthermore, consider what it means to apply the transformer architecture to math problems. I think the tool is a mismatch for the problem. You’re relying on self attention and emergent phenomena to fake computational reduction as symbol transformations. It can probably do some basic maths (all the way up to calculus even) because, in the scope of human life, the maths we deal with are pretty boring. But that’s what they made the wolfram plug-in for as well.
I really think people attribute powers beyond what GPT really is: a colossal lookup table with great key aliasing.
Ask it to add any arbitrary set of random numbers it'd never have seen in its training set and it will do it.
GPT-4 is good enough at math that khan academy feel comfortable hooking it up as a tutor.
Have you actually used GPT-4 for any of the things you say it's bad at ?
Man the confident nonsense people spout on the internet is something to behold.