How has throwing compute at the problem not yielded better results? Are you denying that generative AI has been improving by leaps and bounds throughout the last few years?
Some people are convinced that because we don't have a next gen LLM model (i.e GPT-5) 14 months after 4 and that the best 3rd party models are 'only' GPT-4 level, there must be a plateau or something. Nevermind the 33 month gap between 3 and 4 or the 18 month gap between GPT-3 and the first 3rd party >= GPT-3 level model (Gopher).
Yeah this is like saying after the Intel Pentium came out that welp no one has built an exponentially better CPU in the last year so we’ve peaked as a CPU building species. Even AMDs latest only brought it up up to the same level... CPU winter 1994
I actually think it's worse than that. HTML5 came out in 2008, so nobody could possibly come up with a new internet business until we progress to HTML6! So without a new release of the language, all development stops!
