Same here. I really don't like people leering over my shoulder, and vice-versa. Additionally, I talk to people over the phone more than in person. My office isn't an open floor plan (thankfully). There's lots of rooms, and we're spread out. So, it's easier to ring someone up.
Also, any user issues that I need to investigate are done with Team Viewer. So, even though I'm in the office, most things are done remotely.