afaik, insurance is why the "autonomous" cars still have a person - called the "safety driver"- sitting in the driver's seat, who could take over.
Without the person, the vehicle would not be insured and could not drive on public roads
But, a lot of improvements are needed:
https://www.popsci.com/human-drivers-and-self-driving-cars
A recent, tragic incident in which a self-driving Uber struck and killed a 49-year-old pedestrian, while a safety driver sat behind the wheel,
has stirred up many conversations about blame, regulations, and the overall readiness of autonomous tech
...
emergency braking maneuvers are not enabled while the vehicle is under computer control to reduce the potential for erratic vehicle behavior.
The vehicle operator is relied on to intervene and take action.
The system is not designed to alert the operator.) on May 24.
It reveals that Uber's self-driving systems detected the woman before the crash, but had difficulty classifying her as a person.
The system decided 1.3 seconds before the impact that an "emergency braking" even was required.
However, the self-driving system isn't equipped to initiate that kind of action, or even alert the driver in any way.
"According to Uber emergency braking maneuvers are not enabled while the vehicle is under computer control to reduce the potential for erratic vehicle behavior.
The vehicle operator is relied on to intervene and take action.
The system is not designed to alert the operator,"