I've had people refuse to recognize that I was a technology person if I was wearing a suit since "only business people wear suits." That could be a issue if your role is to be recognized as a technical expert by people who might not be. It can be addressed in most situations, but it comes at an effort cost of overcoming expectations. People use variation in clothing as a queue for expectation.
