> Driving in New Delhi is an entirely different universe than driving in San Francisco
Only if you assume driving is solved as a baseline. For self-serving, "driving" is the 99% of the problem; "driving in $specificCity" is just the cherry on the cake, a small part of the problem that doesn't even need to be solved.
Keep in mind that humans are the most flexible parts of any system they're in. When human and machine negotiate, human always yields, simply because the machine cannot. With increased popularity of self-driving cars, infrastructure and social norms will adjust to eliminate technical problems and cultural idiosynchrasies that the tech can't handle. This is how it always was.
That's sped up at least 5x. If you slow it down to real time, it looks no harder than Waymo videos in San Francisco. Remember that most AVs have full circle sensor coverage. They may do better than humans in situations where there's movement on all sides.
Contrary to your assertions, operating a vehicle in an environment with humans is a social problem.