I'm not going to leave him, we are emotionally tied
Interesting choice of words for a very new relationship. You shouldn't be 'emotionally tied' so soon. You've also taken on the classic rescuer role already, which isn't good for either of you at this point.
The best thing you could do for him is encourage him to take charge of his own recovery, point him in the direction of whatever resources you're aware of, and step back for now from this relationship until he's in a better place.
If he was in an abusive relationship for 20 years, and has, from what you say, only recently got out and/or realised it was abusive, he's learned some really bad relationship lessons, and is really not ready for a new relationship.
And you are likely to end up badly hurt if you construct yourself as the 'rescuer' to his damaged-but-wonderful survivor. Frankly, those dynamics do not last -- the person being rescued recovers and bounds off to find someone who doesn't remind him/her of the time when they were on their knees, and who suits his/her happy, post-recovery new self, leaving the rescuer aghast because 'I put you back together!'