I would get a restraining order on the ex. Talk to the social worker and ask what you would need to do. Your DD can ask to see the files they have on her, she has the right to read and correct any errors.
I have been to hell when SS tried to remove my DGC over one accidental injury. Since baby p they have become ridiculously over enthusiastic to remove babies.
The social worker mispresented information to make my DD fit his criteria for removing a child. It was only the chairwoman of the family court that prevented this happening.
I safeguarded for 6 weeks, if I hadn't they would have been removed during that time while they did their investigations. The whole family have been offered counselling for the trauma they put us through.
One example doesn't keep medical appointments. DD missed 2 out of 36.
Child has an injury that cannot be proved to be accidental, 1 injury in third of three children over four years.
We are lucky, if I can say that oldest DGD has special needs and therefore sees many health professionally. We got these and GP and teachers to attend the family court and give evidence. Yes I fought Social Services. Those that think you don't have to are lucky. If it ever happens to them they will be as shocked as I was.