I agree with you up to the stress bit.
Until we have reliable autonomous driving we should be fully alert while piloting heavy objects through shared space at high velocities.
It adds to your cognitive load sure, but so does killing an equally distracted pedestrian.