Every new generation of GPT models brought a significant improvement: GPT1 demonstrated that unsupervised pretraining of a language model on a large text corpus results in great performance on a variety of specialized tasks; GPT2 which was a simple model scale up and text corpus expansion resulted in a huge output quality improvement (English speaking unicorns story); further scale up in GPT3 resulted in the emergence of unprecedented generalization abilities, and finally GPT4 achieved the understanding of the world and reasoning capabilities that would had probably qualified as AGI just 10 years ago.
In the latest Lex Friedman interview [1], Sam Altman said he expects (hopes for?) a similar level of improvement in GPT5 as the improvement of GPT4 over GPT3. He said GPT5 "just feels smarter" overall.
What do you expect, or hope for, to see in the next big model from OpenAI? What do you think its impact will be on the world?
[1] https://www.youtube.com/watch?v=jvqFAi7vkBc
I keep hearing this, "if you showed GPT4 to people 10 years ago they would think it was AGI!". What complete rubbish. What exactly do you think has happened over 10 years so that you don't have that response? Nothing really. LLM's were released and you gradually understood how they worked and (hopefully) quickly came to the conclusion that they aren't AGI.
Some people thought GPT4 was AGI when it was released, so of course some people would have had the same initial reaction 10 years ago. But just like today, reasonably intelligent people would quite quickly conclude that there was no AGI... Why on earth would you think it would be any different?
The goal posts for what constitutes AGI have not changed but many, many decades.