ASICBoost might be a reason miners are against segwit. But enabling offchain payments kills the P2P aspect pretty hard.
There's no good reason for not having had at least 2MB blocks years ago. And it'd have provided solid info on the real impact, not just fear mongering.
It's silly to say it's not a permanent solution therefore not worth doing at all.