As an example, the Bay Area has some of the best schools and most expensive real estate in the country. This is due to a lack of supply, yet to this day it is illegal to build high density and inexpensive housing in the vast majority of lots so that the less wealthy can start building equity, which again is a huge portion of wealth. Ordinances like high minimum lot sizes and low coverage were deliberately designed to make it more expensive for POC to buy into a neighborhood. This is covered extensively in The Color of Law, and is a great read .
Perhaps the better approach is to fix these systemic issues so that schools didn't have to compensate for them.
First, there's k-12, and not just higher education, which the quality and access thereof is impacted greatly by wealth — Nicer, more expensive homes tend to also have nicer school districts.
It is not a leap to say that a student from a disadvantaged background had to struggle a lot more to learn than one that didn't. Either because of costs (Supplies, tutors, extracurricular activities etc.), or environment (Parent's help and education, support). This is why higher education attempts to compensate for opportunity: They understand the cards are stacked against some groups more than others.
Yes anybody from any race/ethnicity can face these struggles, but remember that a lot of these disadvantages are still _structurally engrained_ to target a particular group. These aren't slight advantages, and housing isn't the only issue, but taken together it has resulted in white families having 6.7x more wealth than a typical black family.