As somewhat of a hyper-lefty progressive (and someone whose wife is an immigrant), I don't actually have any issue with someone merely supporting some level of immigration control, and I don't think I'm particularly weird about that; it's not an inherently unreasonable position to want to keep bad people out of the country. People start getting upset when the rhetoric gets borderline racist, or when they refuse to talk about anything else except some shortsighted, dogwhistling rhetoric that they read off of Breitbart the previous morning.
Example problems: Many racists use anti-immigrant rhetoric, so an anti-racist might take all anti-immigrant rhetoric to be dogwhistling for racism. Many man haters use feminist rhetoric, so an MRA might take all feminist rhetoric to be dogwhistling for man haters.
Both sides then starts seeing the other side as rabid haters sending subtle signals of hate all over the place. As a result both sides gets attacked for having valid opinions and can thus justly declare the other side irrational. Do you see how that can easily make things escalate out of control?
Do you think such escalations leads to more tolerance? I don't. The only way to get a tolerant society is to accept a bit of intolerance, similar to how we have to accept that there are sometimes insect parts in flour, while those insect parts are bad the measures we would need to implement to get them out would force us to throw away tons of perfectly fine goods.