I know this is so easy for me to say from the outside...
But if he truly loved you, and you said "you know, this all moved too fast because you were sofa surfing, there's a lot of pressure on us - and you're miles away from your kids who really need you right - I want you to move out again and we'll carry on seeing each other" then he would agree.
If he was a decent father he'd have done it already. His kids are missing school, and he didn't think it was a good idea to live closer to pick up the slack, let alone do an equal share of parenting? He's not a good man.
He shouts at you, makes it clear when he's not happy that you're going out, makes you miss nights out by failing to come home when he promised (see, he is controlling, isn't he?), admits he was controlling of his wife, throws his phone in temper tantrums, sulks and disappears off in his car (to control your behaviour)... pushes to live with you in the first place...
It's no wonder you're ill and stressed.
A boyfriend (let alone a partner, someone serious enough to live with you) should improve your life. Not make you ill.
Someone you love should make you happy. And not just occasionally.
There's a reason drama follows this man around.
This is so easy for me to say, I know - but lovey, you're allowed to dump him! And his whole bloody drama.
Have you got someone IRL you can talk to? I'm worried about you. Good men - and there are loads of them - don't treat people like this.