I think the idea would be more like legalise and/or decriminalising Xanax or MDMA or whatever it is that recreational users actually want to take (the number of people who intentionally consume opiates is dramatically lower), and to make a reliably uncontaminated supply of these substances available. This could be over the counter (presumably with age restrictions), or it could look more like no questions asked drug testing services.
Xanax (alprazolam) is already legal with a prescription. It is frequently prescribed for insomnia and other sleep disorders. But patients often sell some of their pills on the black market, and now drug cartels are manufacturing counterfeit Xanax pills which replace the active ingredient with fentanyl. Xanax itself has some pretty severe side effects so there would be a lot of resistance to making it available OTC.
Yes there should be good drugs more easily available than bad drugs. Rational people understand they don't want to get their body into a condition where they get into terrible pain if they don't get their next injection soon. Where they have to commit crimes to finance their addiction.
Rational people don't want to take street-drugs which they know might kill them because of bad quality. They are seeing a lot of people dying around them so they know.
This is conceptually not that different from methanol-laced alcohol being available during prohibition. Of course nobody wants to take methanol if they can take ethanol instead. Ethanol is very bad as well. But harm reduction should be the thing that guides our policy.