If the baby was deemed to be at risk as much as you’re all making it out then surely they would of still gone ahead with the PLO*
The baby isn’t the risk here. You are. He is deemed to be a high risk to you in a domestic setting - that will be what they’ve put into their report, by proxy, the baby will be a medium or high risk when he is with you in that domestic setting.
I’ve been here in a custody dispute. If social services believe you are no longer together the risk is reduced, because he is not a risk to you. If you get back together your child will be flagged again, and another risk assessment undertaken.
If I was you, I would be putting every step in place to make sure that I had made it impossible for him to see me, be around me or to have anything to do me. It is your relationship together that creates the risk.
What I would say is that people with a history of DV, generally don’t go away. They toe the line for a bit and then flare up. He will come back for you. He will try and convince you. The baby is the bridge to doing that. That is the risk for you right now.
And if you do get back together with him, because he’s changed or whatever it is you believe, you’re culpable for neglect - because knowing what he is, you put your child in a room with him.
Stay away from him, protect your daughter, and the moment he starts up again because he will, you have to start proceedings for a non-molestation order for you, and cut contact for the baby.