Having to explain this as a guy with small hands to really big guys is annoying. But I have noticed that larger people (physically) don't mind the larger/wider phones. But their hands are actually bigger. I can't use a phone much wider than the iPhone. Once I get to the point that I have to shift the phone in my hand I feel like I'm holding a mini tablet.
I know everyone raves about the bigger devices but I can't use them for more than a few minutes. They're too wide for me, no matter how much I may want to use android I have to side with the women on this one. 3.5" width is the sweet spot for the other 50% of the population. As guys the sooner we realize that our physical characteristics influence what we buy we'll be better off.
For the record my glove size is 7.5, big for womens hands, tiny for guys.