You've already worked this out, but having a baby with this man is a very very very bad idea.
Your money is your money. The £4K you blew at college was your money. It's none of his business (well, it's some of his business since you are married, but only to the same extent that it's your business what he does with his money. And his burbling on about not trusting you with money is so far out of order it's unreal). Start paying it into your own account right now and tell him you will be happy to discuss setting up a joint account that you can both pay some money into for joint expenses. It is really quite scary that he is so controlling; I think it would be extremely unfair on any child to present him/her with a father like that.
You need to learn to drive. You need to learn to handle your own finances. You need to do all the stuff that he's been stopping you from doing. It would be really great if he can be mature enough to cope with that and change himself, but from what you say it does sound unlikely.
You will not be "ending your marriage over learning to drive".
If the "real" DH is the kind, generous and funny bloke you fell in love with, then there's no need for the marriage to end at all - he can use his reserves of kindness and generosity to help him adjust to the changing priorities within your relationship, and put the wonderful connection the two of you have towards trying to genuinely see things from your point of view.
If, however, the "real" DH is the controlling insecure bigot who doesn't trust you to handle money, calls you evil and insane, and begrudges you even the tiny amount of independence that a driving licence would offer, then it's very likely that he may choose to end the marriage. But in that case (a) it's absolutely 100% him who is making that decision -- do not let him guilt trip you over it, and (b) you will be better off without him. If those are the things that are important to him then he's not suitable to be a father, and as you want children so much you ought to be with someone who will make a good father.
Where do you go to make friends? If you want to make friends who like art and literature and history and "high culture" then you need to hang out in the sorts of places that those people will be likely to go.
For example, what about \link{http://www.ncarts.org.uk/about.htm\North Cornwall Arts} -- not sure where in Cornwall you are (and just to complicate matters, the Arts Council England, South West is in the middle of a review of Cornish arts organisations) but they have events you might be interested in attending and also want volunteers to help out. The type of people you'd be likely to meet there are probably less likely to be only interested in clubbing and the Beckhams.
Try the discussion forums at \link{http://www.abebooks.com\Abebooks} for discussion on literature (and on a fair number of unrelated subjects, but it's discussion by people who all share a love of literature even if they don't always agree about it) -- it can seem a bit cliquey at first but it's fine to just dive in. There may be someone near you geographically, too.