OP,
He's really lazy and selfish.
No wonder you want to see the back of him.
He comes back to his heavily pregnant wife and instead of mucking in like a decent husband, he ends up making life harder.
You still love him, sure, but he's not really loveable.
He's a lazy twat who thinks you are the house keeper.
Life only gets busier as children grow.
He's a poor example to them.
Ye are not a team.
I mean this kindly, but you posting here is the beginning of your irritation escalating.
Give it another year, maybe two, and you will hardly be able to stick him coming back.
You'll have been so busy with the children and work on your own, that him coming back and making it harder, will tip you into loathing territory.
My husband travelled a lot at one stage when my children were young, if he had behaved like that it would have been the end of us.
You need to be looking forward to him coming home.
The fact you are not is a huge sign IMO that your marriage is in real trouble.
Ignore that at your peril.
He needs this spelt out to him.
In fact perhaps telling not to come home for a bit might be required, for someone as selfish as him to get the message.
Wishing you well