Driving was like a phobia for me - I would feel sick before a driving lesson, and once Id passed, I would make any excuse not to drive. It was easier then as we lived in London, and public transport was pretty easy.
If I knew I had to drive, I would feel as nervous beforehand as if I were going to an interview! I would spend ages planning my route, and panic if I got lost or didnt recognise where I was.
it had to change when I got a new job in another city - part of the job was spending a day doing visits in a rural area, and I had to live quite a way from where the job was based. There was no way I could get out of it this time, as there was no tube to make it easy!
It was difficult at first, but as DP hadnt yet moved to join me, I had to do it.
As I said, now I dont think anything of driving around here - Im even confident on tiny country roads that I know bother a lot of people. Im not so keen on motorways, but dont have to do that much anyway.
I even drove on the right in France a little last year - something I swore I would never do.
I really sympathise - I could not understand how people could be so blase about driving, as if there was nothing to it. So good luck, give it a go.
Another thought - my last driving instructor was INCREDIBLY irritating - he used to make a little "click" with his tongue if I did anything wrong, eg drove at 30mph - he was very cautious! This also added to my levels of tension, so perhaps I passed my test that time to get away from him!