LF, you can't take the risk. You really can't. It's not just you love.
Your DC need to see you safe, they need to be safe, and they need to see you take ENORMOUS steps to ensure that safety.
His behaviour is unacceptable, to anyone. Those that don't have DV in their background can trust themselves to have a chance at maintaining a clear head, not allow themselves to get sucked in.
You my love, for whatever reason, have been down that horrid road before and know the stakes. Until we actively seek out what it is that makes us vulnerable, and well and truly fix it, when we KNOW that we can spot a scary someone and DEAL with it, regardless of our feelings on the matter, then we know that we ARE strong, safe and secure.
You can't be in a relationship where you feel fear, even for a moment. For this reason, tell him that you will have to take a break, that you hope he can work things out, you wish him well, but that you have to put yourself and your DC first and foremost.
PLease don't think about this, please don't consider your 'investment' (that's always a pile of bollocks) please just make the decision that is the safest for your family.
IF it is meant to be, it will be. But right now, you need to send a message to HIM and to your DC that violence or threats of the same has NO place in your life any more.
Making excuses for him, no matter how Top-Trumpy they look could could you dearly. It could cost a life.