I wonder how many people who talk about "going where they want when they want" actually do that. I mean, how many people can actually decide to pack up in the middle of the night and go on a spontaneous drive to a remote location? I don't know about you, but for me it's not being unable to drive that prevents that, it's having a job to go to in the morning!
I very rarely go somewhere hugely exciting on a whim, but for me, it's all the mundanities - errands, shopping (from shops that don't deliver anyway), borrowing something from a friend - loads of boring things that just need doing, which are straightforward and quick with a car, but which would take a lot of time and planning to do without one.
For me, I see it as like having the internet now when compared with pre-internet days. So many things I can do/send/order/find out in a few seconds rather than it maybe taking hours if not days - or not possible at all. My 8yo DS took ages to convince that I wasn't joking when I told him about the old mail order shopping when it was standard to 'allow 28 days for delivery'.
I realise it's not comparing quite the same thing, but that's the way I personally see it in principle. Then again, some people are quite happy never using the internet (whether a considered choice or just fear/inability, lack of funds or not knowing what they're missing).
Incidentally, I'm a bit surprised by those who say they tried for a few lessons but hated it or found it scary and so quickly gave up. Lots of things in life are daunting and very unpleasant to start with, but you accept that they will get easier and bring you far greater rewards for the future if you're able to face them and persist.