That's definately true. The problem is figuring out how to avoid situations like that without hesitating to speak up around people you don't know well.
I won't pretend to know the answer to that, but my personal approach would be to gather information about the people involved beforehand. If I can avoid as many surprises as possible going in, that puts me on (more) equal footing with the other players.