I think the scale of compute speed really muddies the water with what we traditionally consider a super computer. A DGX pod is probably a super computer imo.
But with some problems we're seeing that we can solve them with petabyte scale lookup tables. Is that a super computer?
I'd really like to hear if there even is a coherent definition anymore or if that line is just blurred forever.
A full DGX pod, like full TPU pod is a "ML supercomputer". The big detail being that they don't typically support all CPU functionality, and tend to have support only for smaller datatypes (float instead of double). However, neither can act as a full replacement for current HPC codes, although that is a very exciting area of research.
But with some problems we're seeing that we can solve them with petabyte scale lookup tables. Is that a super computer?
I'd really like to hear if there even is a coherent definition anymore or if that line is just blurred forever.