Overall it'd be cheaper compared to Sydney and maybe one or two other cities, but more expensive than the rest. Plus the obvious, that living in the middle of nowhere can be quite isolating.
"middle of nowhere" is really vague here. I'm not talking about a station in WA not accessible in the wet season. There's a good number of 30k+ towns around VIC/NSW where you can find lots of social contact.
