Added context: this is a very pessimistic projection, and when it comes true will depend how long the trend in neural network scaling continues.
Most leading ML researchers expect it to continue for a few more orders of magnitude of model size, which I think is enough for my prediction to come true.
Most leading ML researchers expect it to continue for a few more orders of magnitude of model size, which I think is enough for my prediction to come true.