'Especially when if I’m upset he tells me to stop being weak.'
This is not ok.
'I’m pretty fed up of it all.'
If you haven't yet, you could tell him the 'I won't be used as an emotional punchbag' line. That was good.
'Finances he controls and when I ask to look at them, he says when I start contributing to the house I can. Which is nice.'
Wanker.
Whenever he goes on I would just say 'I can't help you, you need to see a professional. Please see the GP as you're making life hard for all of us. If you won't do it for yourself, do it for me and the kids.'' or something along those lines.
If he talks shit, answer him back, it'll show him and the kids it's not ok, and make you feel better.
'Isn't this what you wanted? Misery.'
'No not really, I'd prefer not to live with someone who makes us all walk on eggshells.'
'I'd prefer my husband to deal with his mental health problems, if that's what it is.'
'I'd prefer not to live with a fun sponge.'
I would find this stuff difficult to get out of my mouth, but I admire women who do it.
If this is a repeated pattern then you could consider throwing him out, at least until he gets help.
Best wishes and so sorry you're living with this. xxx