Another benefit: take your spouses/partners; so long as they are able to let you work during the day while they hit the gym/spa/bingo etc. Everyone wins.
Only danger I see is eating too much.
If it's not mandatory then you're splitting your team up for 1-3 weeks.
Some startups demand you travel for 2 weeks a year for "hackathons" in remote locations. I don't see the difference.