I totally agree. I have a friend who is for the most part in the same position as me in my life - married, day job. The only difference is that my wife understands that for my entrepreneurial ventures to bear fruit one day I have to network, meet clients, talk to people, dip into the savings here and there and make up for it and work late or burn the midnight oil. However my friend's spouse expects him to leave his work at 5 o clock sharp and be home and be present and that's it, no and if or but. So he can't even take a freelance gig and do it from home.
A tolerant spouse makes all the difference.