All those other rights are backed up by credible capacity for violence. You need to distribute some of that credible capacity for violence among the populace in order to check the long tail of potential abuses the system (not necessarily the government, though there is much overlap) may engage in.
There's a discussion to be had about what the right amount is though.
There's a discussion to be had about what the right amount is though.