OP only you know where the balance is between wanting to honour your commitment to him and the necessity of honouring your right to physical intimacy as a fundamental expression of love.
Taking sex away for a moment, do you feel loved by him? Do you feel respected and cared for? Does he make an active effort to hug you, kiss you, hold you in a way that makes you feel appreciated?
I couldn't stay in the situation you are in. I would be seeking couples counselling and would need him to be seeking medical advice as a minimum. It's not about you being some sort of insatiable sex fiend - you are a human being who deserves and needs physical affection. The fact that your DH expects you to be ok with no intimacy suggests a deep lack of respect and consideration for you and your needs.
If the roles were reversed, would he stay?
Would you want your son or daughter to live in a marriage like this?
Yes, the finances, the split, the upheaval is scary - I've done it. But it's even more frightening to live without love. My fear of the divorce process was far harder than the divorce itself, and mine took 2 years, thousands of pounds of legal fees, losing friends and a lot of nastiness from ex-DH, but I would do it again with no hesitation.
No one enters or leaves a marriage lightly, but your life sounds far lonelier than mine, and I am single.
Wishing you all the best OP.