Matrix servers can be hosted by anyone and conversations are decentralized, i.e. can't be taken down easily.
the Matrix protocol is accessible to anyone understanding English and having access to the web.
It is even being worked on enabling P2P with Matrix, i.e. each client can spin up a local server that communicates with others (servers) via Bluetooth and other means of transports even if there is not a direct connection possible
but it shows that your argumentation to show that it wouldn't be is flawed, and it is certainly possible that more trust is put in Matrix than it is into Signal
Anyway, no, this doesn’t reflect real usage.