People compare themselves to their spouses. If you feel like your spouse is "our of your league" it's harder to feel secure in your relationship. Men are probably being pretty pragmatic here, given that even though higher income tends to make men more attractive as a spouse, women still initiate 70% of divorces.