No,no. You are desperately trying g to show you are 'being fair'. The trouble is you are trying to be fair to an abuser, its abhorrent.
You need to put your DC front and centre of all your decisions and ignore everything else.
There is a campaign of saving DC harmed through contact. He is not a good father simply because he is abusive.
I am totally in your side. Your only concern is to keep you and them safe.
If you, hand on heart, can say he's never used them to control you, hurt them, sworn at them, threatened them, lost his temper with them, then let him have his contact, but don't do it to serve some stupid idiom of others, legally, or ss or whomever.
If you don't want him to have access because he is a risk then withdraw access and he will have to go to court for safe contact. You have evidence of his nature, of his abuse, of his threats to your safety, have you told ss this?
Speak to Paladin, and keep talking to WA.
If you need legal advice free speak to Rights of Women. Look them up I think evenings up to 9 unless you are in London when there's a different advice line number and times.
Keep strong its horrific yto hear you are going through this. Look at the campaign for children too there may be vital contacts you can make from it. Also Mackenzie friend, and yes LA is supposed to support survivors of DA,but they often don't also!