As said above, Womens Aid aren't just there for women who are being beaten up and need refuge. They are very good with advice on how to achieve just what you say i.e. getting him to leave or you leaving with the baby safely. They can advise you all kinds of things from legal to police to accommodation. Please call them
Are you actually married? What's your current housing situation?
It sounds to me as though you are determined about your next steps and in no immediate danger. I think you should collect information about your rights and possible options. If you won't consider Women's Aid, would you consider Citizens' Advice Bureaux?
If you are frightened of your DH then please take steps to contact somebody and keep yourself and DC(s) out of harm's way.
Your nn says it all - if you have a small baby you'll be feeling extra vulnerable, if you have more than one DC then it would certainly be easier for him to go for a while than everyone else uproot.
Do you have family close by, are there in-laws he can stay with? Otherwise I agree a travel lodge would be a good idea. You say he hasn't hit you, well abuse can be in many forms so please don't think you have to tolerate bad behaviour because he hasn't (yet) raised a hand to you.
If there is any hint of aggression then you must stay safe.
If you don't want anyone else within the families to know you are having problems, or feel in some way there will be pressure from both sides to keep going and endure whatever happens, then please do as suggested, phone for advice. There is no shame in having a rough patch and looking for solutions and young DCs depend on you for protection. Putting on an act might fool strangers or even family but you know what he is like, this is your life, no-one else's.