That's the flip side, yeah. It's why you meet so many aspiring musicians but you almost never meet a failed musician. Much safer to never take that next step of actually trying.
Of course, that's what 'fail early' is all about. As soon as you fail, you can move on to something new.