he threatened to hit you. your relationship with him - as it stood - is over.
you have the chance to change the future here. stop calling him and LET him feel shit about what he did. he deserves to.
he has no right to make threats, and you did absolutely the right thing. he needs to go and stay elsewhere for a while. he needs to see what he's losing. trust me.
you have a very narrow and very tenuous sliver of a chance of cutting this behaviour to the quick right now. ONE phone call saying sorry, begging him to come home and you have utterly lost it AND endorsed his behaviour.
next time (because there will be a next time) he will hit you. without the threat/warning unless you deal with this properly now.
right now you hold ALL the cards, have all the power. you can decide to keep him out, OR decide (providing he behaves) to allow him another chance.
it's too early to make that decision yet, st tell him to stay elsewhere for the weekend and agree (if YOU feel ready) to meet him and discuss the next steps.
stay calm. don't panic. there isn't any need to.