On my servers, I keep a single ssh port open to the internet. It's as secure as possible, but for a little extra good sauce, I also run it on a nonstandard port to help evade port scanners. This sounds like an improvement on that.
Don't worry, though, I would never consider this an effective security measure. Just another layer on top of the others.