No. Sampling truly analog data always involves approximating.
Notice how they use the term "theoretical ideal sampler".
Now, it is the case, as user rayiner mentioned, that there can be advantages to using more than the required number of bits and samples (though not quite for the reasons he mentioned). For starters, you do need an anti-aliasing filter between the signal source and your ADC. Increasing the sample rate reduces the complexity of the AA filter, and digital-domain math can make up for it (and increase the effective number of bits, to boot!). But when you go to reproduce the signal, there's no good reason to use more samples and bits than necessary. That was the whole point of the "Niel Young paper" that has been linked to so many times.
Vinyl does not come close to the limits of consumer-grade recording devices (except maaaaaybe in certain bands, but that can be dealt with by using noise-shaping techniques). Does that make those who like the sound of vinyl bad people? No. Just like those who enjoy sitting in front of a wood fireplace are not bad people. Gas fireplaces have a lot of advantages, but some people like the crackling of the wood and the smell it produces.
 Tektronix made a very nice set of (entirely analog) sampling oscilloscopes in the 1960's which used sampling techniques to measure high frequency signals (on the order of 1GHz when contemporary continuous-signal CROs could barely reach 100MHz). These oscilloscopes displayed discrete-time, continuous-amplitude signals, and deliberately excluded the anti-aliasing filter I mentioned above (though it wasn't true heterodyning as most RF people would think of it, because samples were taken based a delay from a trigger recognizer, and thus not necessarily equally spaced in time).
 Signals below the noise floor are outside the scope of this discussion and usually require some form of synchronous detection (like a lock-in amplifier) or frequency-spreading / -despreading (like GPS).
The page you listed also says: "There has been an industry trend towards sampling rates well beyond the basic requirements; 96 kHz and even 192 kHz are available. This is in contrast with laboratory experiments, which have failed to show that ultrasonic frequencies are audible to human observers"