- Your advancement and promotion chances are basically zero in such a position. Not due to some conspiracy, but just because you're not around for half of the conversations people are having about the direction of the product/team.
- If it isn't standard practice for the whole team, they all start to slightly hate you, no matter the pay difference. Need drewb's input? Oh, it's Tuesday; that will have to wait until Thursday when special-boy is back in the office. I've seen this over and over (including on my own teams) with people who had been granted special work accommodations, and there's nothing you can really do about it, even as a manager.
If you want more time to yourself, I would much more highly recommend attempting to negotiate regular unpaid leaves of absence for a couple of months. Travel the world; really unplug from work; etc. It's both easier to fit into your career and your company's plans.
Or just go into consulting and only take n-month contracts that fit your lifestyle needs.
Unfortunately if you are working from home, you might be building mountains. But no one is seeing you do it, what that generally means is unless you announce explicitly what you are doing people think you are doing nothing.
Contrary to whatever one thinks and the truth is. Perceptions matter a lot more than the reality.
I don't announce anything unless you count commits and issue tracker updates. I am being paid for my work. Those who pay me give me the requirements and know it very well what is being done. Well, since they are paying for it and want it done, how can they not know what is being done?
If only the world worked on facts, and not perceptions...
I posit that "this" is one of those annoying problems of working. If you don't make sure you communicate your success, you won't be successful. People who don't celebrate, share and broadcast their success usually aren't successful. Even when they are in the office 100% of the time.