Driving isn't going to go anywhere, but I can see driving being "penalized" via exorbitant insurance rates - so much so that the it probably might offset the cost of buying a manually driven car.
It'll probably end up being a hobby, albeit an expensive one.