I'm inclined to agree woth most of the answers here that suggest you try a different instructor. I was a really nervous learner driver, but received loads of support from my husband. The day I passed my driving test (on the first attempt!) was very liberating.
As someone else has pointed out, being the only driver in a household is somewhat annoying and I can see your OH's point of view. My friend's husband doesn't drive, doesn't want to and won't learn. One Christmas my friend had to get her daughter out of bed so that she could drive her husband to his workplace to sort out a small emergency. She wasn't very happy about it.
Both OH and I drive and it means that we can share the driving on long journeys, I can take DD to the doctor/dentist/hospital/parties/swimming when OH is away, I can get back to school from work quickly if DD is ill, I can take DD for day trips out to museums etc during the school holidays, I could take DD to toddler groups when she was smaller, I can get to work in half an hour instead of an hour and a half using public transport, we can visit OH's family (who live in a very rural area with poor public transport links), I can do a weeks worth of supermarket shopping on my own, I can take my plastic bottles/excess rubbish to the recycling centre, carry heavy bags of compost and plants back from the gardening centre etc, etc, etc. I can do all of this without having to rely on someone else.
We live in a rural area with a not very frequent bus service and rail service. Both mine and DD's social lives would be just about non existant if I couldn't drive.
If you live in a town with excellent local services and public transport infrastructure then maybe it isn't necessary to be able to drive, after all, I never learned when I lived in the London area.