This is partially because public schools have to also accommodate kids with disabilities, English learners, and those who simply will never keep up. For these kids, public education is horribly accelerated and they're being left behind.
Yes it's terrible for both sets of students. You don't mean to suggest that equal-opportunity educational failure is in some sense better than only failing one group, do you?