You're not alone in that. I also have a very demanding day job along with a few fairly serious community organizations that I help lead. Oh, and also three kids :) I suspect people in situations like this are less represented in the hacker community simply because of time bias. I have to constantly remind myself that some of the (genuinely amazing) things I see people doing are often in a vastly different context than myself. When I don't, I fall prey to the loop again.