That's an interesting idea. My answer would be that even though every volume of space would be contracting if you reversed the clock, each of these volumes don't form their own singularities, instead the near-singularities coalesce at the point of the big bang.
Doesn't this imply that there is a reverse event horizon around every point in space? That we are on the inside of an inside-out black hole?