Incidentally, your comment exhibits some bias of it's own: People with no personal experience in the matter saying it's not a problem and ignoring the fact that those who do have personal experience are saying that it is.
Wait a second - women have no personal experience being a male public figure. So how can women know what level of harassment a male public figure would receive? Do women really believe that "I know better than you do, and I say that you aren't being harassed as much as women are"?
Is this attitude among women also a problem?
And there aren't any women (that I know of) who are telling men that they can't complain about their treatment as public figures. So you've created a false dichotomy. Plus there's the fact that there are male public figures in this thread saying that women are harassed more than they are. So really, we've got people who aren't might not be public figures of any kind telling women who are to suck it up.