A lot of people stay in horrible relationships because they genuinely believe (perhaps wrongly) that it's best for their kids. But you don't have any - in fact you're sacrificing your only chance of having them for a man who treats you like a whore.
So why are you there, sweetheart?
I think it's obvious to everyone but you that your husband's not the problem here.
That stuff with the holiday is just weird. Why did you do as he told you? Why didn't you tell him to go fuck himself? Have you always obeyed orders and towed the line?
Honestly, is this what you think life is about? It's only short, and you've already wasted so much of it on this guy. You might die next month, next year, we all might. Do you want to look back on your life and think about how you were his blow up doll? Why don't you think that your happiness matters?
I agree with buzzsore. Go and see a solicitor, initiate divorce proceedings and leave on the same day. No more contact.
If you can't bring yourself to do that, get some counselling. Pick up the phone and book it tomorrow. You have to somehow realise that you deserve better than this.