It was because the new people were not white. They were black. The culture was not a factor, no matter how respectability politcs exactly as white they acted, they were black and thus a threat.
There are plenty of blacks (and latino, indian, phillipino) in my neigborhood as it's a firmly middle class neighborhood. What we don't want is CRIME and transient residents that don't care about the area along with the landlords that are out of state.