Let's say that I'm one of these people. It's already illegal for me to send a UAV to your house with Semtex and a proximity sensor, since trying to kill you is already illegal. What makes you think that a ban on UAVs will stop me? How will a ban on UAVs help you protect yourself from my illegal murder attempt?