That isn't to say "give them $100,000." That is to say it will cost money to put the programs in place to get education on an equal footing, including things like sufficient food subsidies that aren't based on calories but actual nutritive equality, and making sure that these graduates don't have soft discrimination like this: http://www.nber.org/digest/sep03/w9873.html
There are cultural issues, to be sure, but they don't all lie on those in poverty.