I would opt for the car in your situation. Even though I prefer to take public transport whenever possible. I'm pretty sanguine, so don't get stressed out that much either way, but even I had enough after two years of manoeuvring a pushchair and assorted bags onto and off Edinburgh busses. Especially since they don't wait until you have a seat or have reached a place you can hold on to. Fell over quite a bit.
So then I was in a similar situation to you - already had a driving licence but hadn't driven at all since then (about six years). I definitely needed refresher lessons. My driving instructor was an arse, too, but the poor man had an arse for a pupil
as well. That's because it was my DH and he has no patience and I don't react well when men tell me what to do. Plus the stuff he kept telling me didn't make sense until I had driven for a few years.
I'm 5'5, so am currently feeling like giant next to all of you! But DH and DC are 6 ft tall and they drive my car regularly which always reminds me just how short I am. My legs are fairly short (always have to buy short length trousers), so I sit really close to the steering wheel, too. Which I'm now hyperaware is a problem but WTF am I meant to do? I can't reach the damn pedals otherwise.
As for wankers on the road vs wankers on public transport. To me and at worst that's a toss up between wankers who endanger you vs wankers who harass you. And at best it's annoying wankers that mar your journey. I'm pretty sanguine, as I said, so I don't pay any heed to annoying wankers on the road, but annoying wankers on public transport are usually in your space. Right in your face if you're unlucky.
So greater freedom, flexibility and less travel time plus lower degrees of wankery equals car. And an awareness that my risk is greater, but DH taught me to be a defensive driver, so it's a risk I'm willing to take.
I'm currently driving my smallest car ever (Toyota Yaris) and I love it. Used to drive a big Ford sedan, two American SUVs, a Renault Espace, a Chevrolet Tacuma and some monstrously strong-motored big BMW thing on occasion. Yet the Yaris is my favourite, despite or maybe because of the size and because it still has enough power for my purposes.
Might well be true that people behave differently coz of the size, but I haven't honestly noticed. But then, like I said if I notice annoying wankers on the road at all, I've forgotten about them by the next traffic light.