...but that's... not how I described the office in question.
We stayed up very late, listened to loud music
To me, the two are related. You stay late because there's loud music playing. If it was quiet, you'd get your work done and go home at a reasonable hour. Instead, you have to deal with loud music, co-workers playing foosball, people coming and going behind you, and as a result, you don't end up leaving until 9pm or later.
That's a presumption, unstated in the comment, and it is incorrect.
I have worked at... I don't know how many co-working and incubator spaces. And of those, some had a very socially lubricated environment at night that sometimes included loud- (or even live-) music.
But never have I experienced loud music during the day except on some special occasion (ie holiday party or something).