Partially. I work heavily in the AI space, both with GOFAI as well as newer concepts like LLMs.
I think scaling LLMs with their current architecture has an inherent S-curve. Now comes the hard part to develop and manage engineering in the space with ever increasing complexity. I believe there is an analogy to efficiency of fully connected networks versus structured networks. The latter tend to perform more efficiency, to my understanding, and my thanks for inspiring yet another question for my research list.
This s-curve good, though. Helps us to catch up and use current tech without it necessarily being obselete the second after we build it or read about it. And as the current generation of AI can improve productivity in some sectors, perhaps 40% to 60% in my own tasks and what I have read from Matt Baird (LinkedIn economist) and Scott Cunningham. This helps us push back against Baumol's cost disease.
I think scaling LLMs with their current architecture has an inherent S-curve. Now comes the hard part to develop and manage engineering in the space with ever increasing complexity. I believe there is an analogy to efficiency of fully connected networks versus structured networks. The latter tend to perform more efficiency, to my understanding, and my thanks for inspiring yet another question for my research list.
This s-curve good, though. Helps us to catch up and use current tech without it necessarily being obselete the second after we build it or read about it. And as the current generation of AI can improve productivity in some sectors, perhaps 40% to 60% in my own tasks and what I have read from Matt Baird (LinkedIn economist) and Scott Cunningham. This helps us push back against Baumol's cost disease.