I have a very similar schedule. I use 5am to 630pm to work on my side project. Sure, I only get 1.5 hours a day but it works for me, and over the past 4 years I've made enough progress to keep me happy. My primary motivator is the joy of working on my own idea, but hope to launch this in the next 2 years. (I'm working on an app.)