your right I need to keep away from him. But he keeps knocking on my door.
You sound completely passive here, and while I understand you have been dominated by him for years, you sound as if you really do not understand that he does not have the right to come around and ask to be let in.
....
I know u might think why do I let him in but last time I didn't let him in he broke my front door. I tried to explain to social services but they didn't do anything. I was going to go to a refuge with my son but social worker at the time said I'll be selfish as my son enjoyed going to his school. At least if im monitored or put in a unit he will have to stay away. He doesn't ask me for money or abuse me anymore. But I told ss if his going to be the reason I loose baby can u move me. But they said I have a nice flat and dont need to move, so I assumed having contact with him wasn't a problem.
There are two problems:
One is that he is aggressive and frightening, and therefore abusive.
The other is that you want everyone else to solve the problem of him maintaining contact with you. This all by itself is a red flag for SS.
You have misunderstood what SS have said to you. You do not seem to understand that SS wants you to show determination not to let him into your home or your life (phonecalls, etc). What they have said is that they cannot do this for you. The implication is that you must do it for yourself, where you are now, all by yourself. (They want to be sure you do not end up with someone else just like your ex either, on the rebound, but that is for the future).
They did say to me if he ever gets aggressive with me again I must call the police but if I do that im worried they will use it against me.as they did before. I will do my best for baby and apart of child protection plan it have said I only want him to see his baby set days rather than coming round when he wants.I do need ss help with this as im not strong enough to do it alone. That's why innisally I wanted social services in my life when my son was in my care because I was hoping they could give me some support. I didnt know my son would be taken away as I looked after him very well.
What worried them before (I would bet £££) is that you called police when he was aggressive but then stayed in the relationship. You want SS to act as referee in this relationship that you have no intention of ending. That is not their job.
I would be willing to bet £££ again that your statement that you want him to see the baby only on certain days is ringing loud alarm bells in the SS office - this cannot happen. Can you not see that this constitutes maintaining contact with him? Maintaining contact is the issue.
Since you have already called police (there will be a record of this call) then you can possibly get a non-molestation order. If there has been violence or threats or aggression in the past and you have broken up and he has moved out, and if you have told him to stop coming over (esp since he broke down the door) then you can possible get that non-molestation order as what he is doing sounds like harassment.
Please ask the police domestic violence officer at your local station how you can get one.
You are sounding completely passive when the topic in question is this man. You seem to feel ambivalent and unwilling to make a decision to cut him out of your life and then stick to it, or use tools that are available to you to show that you mean business (the tools are the non-mol order and good communication with SS wrt how YOU are going to go about getting exP out of your life and keeping him out.)
Whether you really want to or not, you have to cut all ties to this man. This means cutting all contact, and it means signalling to SS that you are serious. It also means following through on any order you get against him, so if he knocks on your door after he gets the order you have to call police.
I agree 100% with Gallavich that you do not seem to understand how important it is that this man gets completely erased from your life. If this is clear to people reading your comments on a forum, you can be sure that SS can hear that when you talk to them.