Glass with a silicone sleeve over it is surprisingly resilient. I have had a few glass bottles with silicone covers that I carry around (not all at once...) and have dropped them more times than I can recall and they always just bounce. Of course they can break, especially if you do something like put it in your shopping cart and drop something heavy on it (whoops).
The inertness of glass not only makes it always the first choice for food contact, it's also the most cleanly recycled material on the planet, when it does break. Unlike plastics (which for all practical purposes can't really be recycled), and metals, which require complex separation and realloying, glass can be easily separated visually and reused indefinitely. It is quite likely that the glass in your refrigerator right now contains glass first produced by the Romans.
(Of course, we should just reuse glass containers, like we did when I was a kid - a small deposit is a big motivator for kids to collect bottles for reuse!)
More than steel? We're talking about reusable bottles here, shipped empty. What is the comparison of empty glass or steel to full plastic? What is the difference in mass?
There exist industrial reaction vessels etc which are made of stainless steel with a bonded liner made of glass. That seems like the ideal "forever" food container material to me - chemically nonreactive and easy to clean, but lightweight and resilient to impact. The glass layer would be lost in recycling, but it shouldn't impede recycling the metal too badly as it'd just be a tiny bit more slag in the crucible.