Maybe your city has a “safety of crowds” thing going on but when cash only businesses start going scarce, I bet the remaining holdouts start getting more and more scrutiny.
The money industry tends to be heavily regulated, and self-regulated (PCI DSS) for a reason. Crime happens there because that's literally where the money is.
I'm doing my part, though. I pay with cash whenever I can. In Germany that's easy (often the only option e.g. in restaurants). In Sweden, not so much. And then there are countries in between.