Bloody hell OP, what the actual fuck have I just read?! Is this truthfully how your life genuinely is?
You need to leave this man ASAP. Not when the DC have started school/nursery, you need to start making plans and taking action NOW.
Your husband is an utter wanker. Sounds like he's basically told you to your face that he's planning to leave when he gets the chance, so you're nothing more to him than a domestic appliance, caring for his DC and looking after the house AND USING YOUR OWN SAVINGS FOR THE PLEASURE OF DOING SO! You are worth so, so, so much more than this pitiful excuse for a marriage.
My ex husband turned out to be a lying, cheating, spineless, duplicitous weasel of a man - but he would never have dared to murmur a word about the state of the house and he always covered all household bills as he earned significantly more than me.
You aren't a team with this man - he's using you and you're fully aware of it. I promise you that staying in a marriage for any length of time where you're treated with contempt will totally do a number on your self esteem and ruin your confidence and sense of self - I've been there. Staying there isn't worth any amount of money as you can't put a price on your own mental health and self worth.
Divorce this useless fuckwit while your DC are still so young that you being apart is all they've ever known/remember. I've seen through friends that this makes the situation easier and better for the DC as they grow up - it's all they've ever known so there's no anguish around the divorce or having two bedrooms in two different houses etc.
You sound like a sensible, strong woman with good earning potential so you'll thrive without him as a deadweight around your neck. Life after escaping a rotten marriage is so much better!