On: Google open-sources TorchTPU, a native PyTorch back end for TPUs

A decade is a long time and the highest end isn't the only market segment.

High bandwidth flash will be here soon, I bet someone makes an economical competitor thats not quite as fast but much cheaper.