The whole point is that people who don't have your privileges can't afford to take as many risks, the same hard work has a smaller payoff, and the cost of a mistake is higher.
Privilege doesn't mean getting where you got was easy. It means that for those that don't have it, it's way, way, way harder to get to the same place.
All I have is my own experience here, and at least in the UK I've almost never witnessed any kind of prejudice keeping people down - on the contrary, IT is crying out for women, ethnic minorities etc - with one major exception: the class system, which without question still matters when going for jobs in e.g. the City. However, not being a posh boy from grammar school, I don't benefit from that.
> and at least in the UK I've almost never witnessed any kind of prejudice keeping people down
You haven't been paying attention.
Black people are more likely to be subject to stop and search than white people. In particular for drugs even though they use drugs at a lower rate than white people. Despite knowing about this injustice for years rates have got worse. https://www.theguardian.com/law/2018/oct/13/racial-bias-poli...
Black people are more likely to be detained under the MH Act, more likely to be subjected to restraint and rapid tranquilisation, and more likely to be on a community treatment order. This is probably racism. https://www.gov.uk/government/groups/independent-review-of-t...
Black doctors get paid less than white doctors; BAME health care professionals have complaints investigated more often than their white collagues and those complaints are more often upheld. THis is probably racism. https://blogs.bmj.com/bmj/2018/01/31/amitava-banerjee-instit...
The whole point is that people who don't have your privileges can't afford to take as many risks, the same hard work has a smaller payoff, and the cost of a mistake is higher.
Privilege doesn't mean getting where you got was easy. It means that for those that don't have it, it's way, way, way harder to get to the same place.