For music collection and playback (low-bandwidth low-parallelism sequential reads), a mechanical drive would probably be substantially cheaper than SSD for large capacities without a substantial performance hit (though I don't know if you even need terabytes to store music). Anyway I have a 256GB Samsung 850 PRO SSD from a 2016 laptop, which I've used on and off and swapped between devices, and hasn't failed yet.
Not sure what OP's specific use case is, but for me, the one big downside of spinning drives is noise. And even if the drive itself may be fairly quiet, you have to make sure its vibrations don't propagate to furniture where they can get amplified.
Good point for especially storing music files. I'd like to use SSD every time for < 2TB data. Unfortunately, I'm a data hoarder so still spinning rusts.
I suppose it depends on the drive. I have a cheap external WD "passport" drive I use for backups. I sometimes sit it on a wooden end-table at my parents' house, and you can absolutely hear the vibrations.
That's very dependent on Amazon actually shipping you the drive, which between my recent experience and tales from a few friends in the industry, is much more of a coin toss these days.