We started doing it again after a pause 10+ years ago. Back then, it appeared some payment systems had some bugs where they wouldn't always pay on time, or would double pay, so we stopped. However, now the physical mail infrastructure is prone to delays/failures, we're moving back to autopay.
Some places give the option to autopay via credit card, if you are hesitant to use a bank account. I know some people open a special checking account solely for autopay, and just make sure it has enough funds every month. It could limit exposure to other accounts.
Where do you live? Where I live (somewhere in the Europe) automatic wire transfers have been a thing since forever... I don't even remember when was the last time I paid my utility bills in cash. I would imagine the US has similar basic facilities too. Have no idea about other parts of the world.
I use autopay through my bank. Never had an issue. They tend to have agreements with most payees that make it electronic, but otherwise they fall back to mailing a check.
internet banking...you dont really want automatic withdrawals from the utilities, what you gain in convenience you lose down the line when you want to cancel it
Some places give the option to autopay via credit card, if you are hesitant to use a bank account. I know some people open a special checking account solely for autopay, and just make sure it has enough funds every month. It could limit exposure to other accounts.