There is a bit of an advantage to "exotic" locations, though -- shared unfamiliarity. If it's new for everybody, then everybody is learning at the same time. It gives you something in common. Having said that, though, I've had discussions with the team I'm on where a lot of people would love to get together in a relatively boring place where the only thing we could do is code together. That has a lot of advantages too and I'd be surprised if you couldn't get some backing from other teammates to try it at least once.
And yes, boring but neutral (non-exotic, non-expensive) locations seem like a reasonable ideal for a business trip - that's essentially what I'm advocating. They can also be unfamiliar to all, if you think that helps - it doesn't have to be the Bahamas to not be somebody's home turf.
But there are, as I've explained, good reasons for it to be something other than the (expensive, particular-lifestyle-centric) glamor most tech companies push - larger reasons than the neutral ground piece. It alienates more than it includes, and burns money (sure not yours, but you'd rather your company be prudent, or at least let you spend money on things you want) and carbon to boot.
Also, I'm not vilifying all exotic travel - just the habit of entangling it with work, as it becomes a heavily asymmetric perk and a significant cultural filter/selector (for a certain sort of "living life" crowd - again, not bad people, but not the only sort of people in the world). I'm all for places giving vacation time, and paying well enough for employees to pursue their interests, be that the Bahamas or rare book collection or anything in between.