True unless the server is not on the public internet. In that case, pulling the plug if port 22 is accessed would be a reasonably defensible idea (you are being attacked for sure, and it's hard to attack a machine that is off) ...albeit paranoid in the extreme.
If all you do is grab a fingerprint, you will interact with the system less than the script kiddies.
So, if it was going to fall over, it would without you grabbing the fingerprint.