The efficiency of training has very unlikely reached its peak or near its peak. We are still inefficient.
But the bottleneck might be elsewhere, in data, what we use to feed them.
Maybe not peaked yet, but the case can be made that we’re not seeing infinite supply…
Maybe not peaked yet, but the case can be made that we’re not seeing infinite supply…