Exactly. I'm playing Red Dead 2 now and it's mind blowing how slow and limiting the controls are despite the world looking so full and lively. For the sake of realism and movie-like presentation, the player is reduced to A-B button pushing, to not interfere with the nicely laid out scripted scenes.
One thing I've picked up on that I especially hate is when a cut scene has you press buttons solely for the sake of interactivity, i.e. they don't utilize game mechanics.
"Press X to..." in a situation that you will never encounter again or press X again in. Like the cut scene isn't teaching you a mechanic, it's just making you pay attention.