In my solipsistic personal and 100% anecdotal experience, making room for something philosophically 90+ degrees away from your day job is a learnable skill. I've frequently coped with ghastly day jobs (including my brief stint at Google except that it was a ghastly day job with great food) by working on something technical into the late hours of the night.
Don't underestimate yourself.