I haven't heard that argument since I was a teenager, would any serious adult today use the argument that we shouldn't use tool X because other people, including people we don't like use them?
The arguments for gun control are very similar - in addition to “people we don’t like” it also includes “people we do like but don’t handle them safely enough”.
Also, that’s big media’s claim against torrents. And the war on drugs started by Harry Anslinger was basically started along those lines.
It seems “percentage of use by people we don’t like / for purposes we don’t like” plays a big part.
