I can drive.
I have a car.
But I really don't need to, living where I do (not London).
Buses every few minutes, including to train station, coach station, hospitals.
Schools, shops, church, community centres all within walking distance.
Cheaper to get a coach to the airport when we go on holiday rather than paying parking fees.
And we all have bikes. And cycle tracks.
If I drive to our nearest big supermarket (3 miles), it takes me 10-15 minutes with traffic and queuing for parking. If I cycle, with my trailer for children/shopping, I can get there in about 15-20 minutes, cycling along tracks following the river, seeing rabbits and birds and autumn leaves. Or I could walk to a smaller shop in 5 minutes, or send a child (half an hour plus sweet money!).
My car doesn't get used much, and so it can become a little unreliable - flat battery kind of thing. So if it's at the garage, or duff when I need it, I'd get a taxi instead.
It would be cheaper for me to give it up and use taxis for emergencies or trips to less accessible places. I don't, because we camp. And I can't imagine trying to get all our camping gear on a bus/coach/bus/taxi to the campsite.
If I had to stop driving, I'd get an electric bike. Very popular round here. No faster than ordinary bikes but much easier uphill.
Personally, I'd say forget well meaning other family members who think you ought to drive. But do have an honest chat with your husband. Does it stress him, being the only driver?