I think if a post goes -1, anyone else downmodding should have to reply to be allowed to downmod them again. I am all for the karma system, but I have had situations where people misinterpret what I am saying and after requesting a "why," I find out changing one word makes people understand to the point of me not being negative.
(And burying a dissenting opinion for no reason should need a defense.)