Hm, seems you're right - I think what I must have been remembering was comparing control of home automation products via Alexa/Google (voice and app are similarly responsive) to non-voice HomeKit control. (But even Siri voice seems more responsive than e.g. Alexa voice for Hue, presumably because commands just bounce to Apple and back to me, rather than to Amazon, then to Philips, then back to me.)
I don't actually use voice control on phone, so I guess what I actually want on my Android phone is just HomeKit, and not Siri. (Would also let me switch my camera to HomeKit Secure Video, which I can't practically use with my primary carry being an Android phone, despite owning all of the prerequisites.)