Anecdote: I've been described by a recruiter as "a culture fit" (definite article and all), and not in reference to any particular job or company. This dude knew roughly nothing about me except how I looked and my generic California accent.
If you think it's about excluding people who have kids or don't want to drink all night you're actually giving them too much credit.