It's entirely down to whether the experience retains 1 to 1 movement between your head and the camera in the game or whether joystick movement or in-game animation yanks control of the positioning of your head/camera and moves it somewhere your real/physical head is not.
