Very true. Much of the respect shown by reports is out of fear. Everyone complains about their boss behind his/her back. Now you have to suck it up and realize that this person is now you.
That being said, is can be satisfying for people to recognize you as 'the boss' when you're around.
On your downside list you need to clarify that being treated with respect isn’t the same thing as being respected.