The assumption of the time was that it was common-sense that the Constitution was a whitelist, not a blacklist. There was pushback against having an enumerated Bill of Rights because then there would be a whitelist of rights, and the Founders feared this would mean that they'd miss something and in the future their government would become oppressive.
Hilariously ironic how things turned out instead.