It might not be fair to expect it, but it's absolutely fair to count it against how Apple supports their customers.
This isn't even close to what he said, and it only makes sense if you have an extremely reductive black-and-white view of the world. There are places on the spectrum between "perfect support" and "absolute shit support", and the phrase "count against" simply implies that supporting decade old hardware is a notch higher than the same support setup without that advantage.
Computers have slowed down. Basic support for for 10 years is not a crazy idea.
 iPhone 6S available 25 September 2015, iPhone SE available 31 March 2016
Might not have been measurable, and might just cost an extra engineer without really harming anything.
If they had gone 64-bit-only, I'd be much more in agreement with you. But if you're still supporting a 32 bit platform, you have a lot of restrictions put on you, and the marginal cost of keeping support for a second 32 bit platform is not a big deal.
At minimum, slow systems require gracefully degrading GUI, which increases complexity by an order of magnitude. The graphics card capabilities are a much better first approximation than the word width.
If it took just a few extra engineers, or a few thousand, to fix the bugs that they have, Apple would have done it. The Mythical Man-Month, and all that.