Thinking about how our eyes really work - you don't need the same resolution. You only need proper eye tracking and the right amount of resolution in the center of your vision (or wherever). You only need it to render what you are looking at - I'm sitting about 2 feet away from a 27 inch screen.... I'm never looking at the entire thing in such a way that I need all that detail at every point. Sure, I need it to be there when my eyes dart around... but as long as that's done, it will look just as real.
Given something more adaptive, there's no reason you couldn't have a ginormous holographic wraparound workspace... or whatever your imagination can come up with.
Given something more adaptive, there's no reason you couldn't have a ginormous holographic wraparound workspace... or whatever your imagination can come up with.