On: TPUs vs. GPUs and why Google is positioned to win AI race in the long term

[bigyabai]

They don't have to, CUDA is a high-level API in this respect. The hardware will conform to the demands of the market and the software will support whatever the compute capability defines, Nvidia is clearer than most about this.