> But CPUs are maxed out for now, I think, so I'd expect that the current cycle will be a long one.
CPUs in the future may be a mixed bag, there may be different coprocessors, but integrated in the same physical chip - more advanced SoC. At least this picture is what I find to be the most convincing after the end of exponential scaling by Moore's Law.
Yes. It is already an issue of AVX2, which has the hilarious problem that the user must try finding a net performance gain between speeding things up and heating the CPU into thermal-throttle... But I think if an on-chip coprocessor can offload a common task and making it more energy efficient, the thermal issue can be avoided. We've already seen successful applications of cryptographic instruction sets / coprocessors, video transcoding, and the number can only get bigger.
CPUs in the future may be a mixed bag, there may be different coprocessors, but integrated in the same physical chip - more advanced SoC. At least this picture is what I find to be the most convincing after the end of exponential scaling by Moore's Law.