One part of the argument you are missing is that FSD requires real-time decision making as well, so when complexity goes up with a larger number of inaccurate sensors that can become an issue. No one cares if getting a picture of a black hole from noisy data takes one year to process, the same is not true for self driving.
