The real outward problem of drugs is poverty. As we've seen from a certain mayor who has been in the news lately, the issue people have with drug users is them "breaking into your house for $5"[1]. If you have the means to use the drugs without financial repercussions, then it is "okay" (a term I use lightly here). If you tax the drugs at a high rate and make them still inaccessible to some degree, then the problem persists exactly as it does today, with criminal organizations supplying the drugs at an artificially inflated price to the people who can afford them least.
I knew (personally) of a surprisingly large number of white-collar functional addicts who worked in the city and earned mid six figures.
Hell, I technically am in the category myself with my Suboxone treatment. My life is better than fine, and has been since I went from paying $400 a day for heroin, to $5 a day for suboxone.
My lowest points where when I was poor and addicted. I never stole, and went through withdrawals instead, but I can tell you it crosses the mind of any addict at some point. Take that away, and the impact on society is lessened considerably.
[1] http://www.cbc.ca/player/Shows/ID/2416184416/