I kind of agree with your first part. For a while now, I've considered the possibility that a handheld device like an iPhone is actually pretty close to the ideal way humans actually want to interact with a computer. Even though it seems cool as an idea, I don't think people want their experience with a computer to be too immersive--handheld device might be the sweet spot.
