Sure. But, IMO, it (chatGPT) is about the quality of a first or second year uni student right now (albeit in every subject at the same time), including being confidently incorrect.
(I've not done a systematic all-subject study; this is based on the comments I've seen from experts in a mere handful of domains, plus my own knowledge in my own domain).
"""Thamus, however, replied: “O most expert Theuth, one man can give birth to the elements of an art, but only another can judge how they can benefit or harm those who will use them. And now, since you are the father of writing, your affection for it has made you describe its effects as the opposite of what they really are. In fact, it will introduce forgetfulness into the soul of those who learn it: they will not practice using their memory because they will put their trust in writing, which is external and depends on signs that belong to others, instead of trying to remember from the inside, completely on their own. You have not discovered a potion for remembering, but for reminding; you provide your students with the appearance of wisdom, not with its reality. Your invention will enable them to hear many things without being properly taught, and they will imagine that they have come to know much while for the most part they will know nothing. And they will be difficult to get along with, since they will merely appear to be wise instead of really being so.”""" - https://newlearningonline.com/literacies/chapter-1/socrates-...
It would be an ironically Greek tragedy, if the end of human civilisation were to be caused by a (written) language model, especially given how many Κασσάνδρα-analogs we have had from (given this hypothetical outcome) Socrates to Yudkowsky.
It's very easy to construct examples where its summaries, while they look correct, either miss some crucial point or are outright incorrect.