I find the IAT somewhat ridiculous. For example, it asked whether I associate black with "sports". Well, I do, but there is nothing "implicit" or "biased" about it. It is my lived experience as a high-school sprinter.
In addition, stereotype accuracy is one of the largest and most replicable effects in all of social psychology. It's not "wrong". What would be wrong is not adjusting for the individual once you get to know them, but AFAIK that same research also shows that most people drop the stereotypes quickly once they actually get to know an individual.
And yes, there are people who don't. In other news, stupid people exist and earth still round.