Alternatively you could use rsync or lsyncd which are much faster and better than SSHFS.
Anyway I don't think this was created for use over SSH. Most people that use it are going to be working locally, in which case a proper GUI is much better.
CUI apps are really meant over SSH imo. Like you say, local use has wider alternatives including GUI in which case I prefer SourceTree over any CUI tools.
On Mac I use GitX which is a little buggy but I think it has the most logical UI. Sadly it isn't cross-platform.
GitAhead is also worth a look - it was a commercial one but is now open source.