I'm so sorry things are so tough at the moment. It must be really winding him up to see that you have a life of your own, and plans, when he evidently has been thinking of you as some sort of member of staff he can pick up and drop as he pleases. Carry on regardless, I'm sure he would love to cow you into behaving as if you can't live without him, how else will he feed his massive ego? As for all that s**t about paying for everything, well, that's the way it often is when you have small children, that was what he agreed to, it shouldn't ever mean you are any less than an equal partner.
You were good enough when he chose you to be his life partner and mother of his children, and I am sure you haven't changed into a different person, he is looking for evidence that he was justified in going off with someone else, and of course there is none, so he is making some up.
Hold your head up high, take no notice of him, as others have said, he has lost the right to dictate to you. Your life is in front of you and you are its architect, not him.