Are you using Home Assistant? You seem to be all in and I've started doing the research to get my place setup. I think I would like voice commands for quick actions but would like to avoid giving my voice data to Amazon, Google, Apple, etc. There seem to be some limited open source models, but their support currently seems limited.
I have not tried Home Assistant, no, but I'm keeping an eye on what happens with Matter. If I were able to consolidate the interaction to a neutral third party that could control the other stuff I already have, I'd love to do that.