(Yes, it's technically possible to remove the DRM with tools like Calibre, but now you're breaking the terms of the agreement under which they were sold to you in the first place.)
I occasionally check out ebooks from my local library via Overdrive. The DRM doesn't bother me in that scenario, since I have no expectation of being able to keep a library book. But I would never in a million years "buy" one.
As I age and my eyesight gets worse, the ability to pick a large font is a godsend. I'm not happy with the DRM, but I'd be even less happy not being able to read just about any book I choose.
Of course, I'm not going to live forever, and as I get a more realistic appreciation for what books I might re-read in my limited lifespan remaining... I just don't worry about DRM anymore.
I'm not going to be passing on these books, the next generation likely won't be interested in most of them. The really good stuff will stay in print somehow at a reasonable price (or at least there will still be piracy).
The other stuff, meh.
Then you can download a de-DRM-ed copy, and use it, because they often come in a better layout, actually fit for reading, and are not going away.
Maybe publishers will eventually understand that their books is going to be pirated no matter what, and start to compete with pirates on quality and affordability. See, this actually happened to most of the music, so there's hope.
But what I don't like is that publishers have been jacking up the book prices to the point where they cost more than the cost of having a physical book shipped to me. When I see that, then I usually just buy a used book, to make sure the publisher gets no revenue from me at all.
I thought digital publishing would be a boon for publishers and readers alike -- reducing prics by eliminating the cost of printing and keeping inventory, yet the publishers are using the convenience of the eBook reader that I paid for to charge me even more money for that book.
2 years ago I was reading 75% ebooks, 25% paper books, now that's flipped the other direction.