The learning curve mostly. And most things you need are there out of the box, or very easy to install. Also plugins like remote ssh. Overall it just works without too much effort.
Remote ssh is built into vim. I think it's formally a plugin, but it's installed by default.
Of course, if you don't use too many plugins, vim is also designed so you can run it remotely. I use this sometimes to have a long-time running vim session on a remote server, using tmux or screen to reattach when I log in.