From what I can tell, hardcore audiphiles tend to stop at stereo, so there's that. But if you're going to match speakers, I would think you'd want to at least match by type: match your fronts to each other, match your surrounds to each other, match your heights to each other, match your subs to each other. Just having all of one type be the same model is probably good enough though.
