You weren't just believing things. The difference between 44khz and 96khz sample rate is very noticable even with mediocre audio equipment. It's an overstatement to refer to the situation as a "hi-fi case". 16/24 bits however makes no difference at all except on the size of the material.
