I've done a road trip more than 1000k on a ~$100 aluminum frame and vibration was never even a minor concern.
If you're going at very high speed or constant rough ground I can see how it'll get you, but seat design and quality of shifting/braking components were by far the biggest factors.
