It's primarily an issue of overpoliteness: The ML model's training is increasingly populated with "No, don't do this", and as such, learns to just not do anything.
It's only when deliberate uncensor-ings are made that some form of usefulness can be clawed back.
Philosophically, it's amusing to apply this overcorrection back onto allegories for daily human life, wherein the tension between order & creativity are always in conflict.
If you're told from birth that everything you're doing is wrong, eventually you'll become creatively and intellectually stunted, increasingly relying on authority figures to tell you what's morally correct.
https://huggingface.co/ehartford
https://huggingface.co/ehartford/Wizard-Vicuna-13B-Uncensore...
It's only when deliberate uncensor-ings are made that some form of usefulness can be clawed back.
Philosophically, it's amusing to apply this overcorrection back onto allegories for daily human life, wherein the tension between order & creativity are always in conflict.
If you're told from birth that everything you're doing is wrong, eventually you'll become creatively and intellectually stunted, increasingly relying on authority figures to tell you what's morally correct.