I wouldn't judge without knowing the circumstances because while we can assume that SS usually make good decisions and are usually competent, professional etc, this is not always the case. Just like there is the odd teacher/doctor etc who can let down an entire profession, there are social workers like this.
I know someone who had her children removed and placed with their father, despite his proven history of domestic abuse (including police convictions). It is genuinely one of those cases that you can't believe and that without reading the many reports, email chains etc you would assume there is more to it, the mother must have been abusive/neglectful etc. The truth is she was by no means perfect but so far from being neglectful it's a joke.
She is fighting the case and raising a serious complaint against SS, but without legal support that is tough. And SS managers have totally covered for the main social worker involved. AND the court said following the removal of the children that SS had no legal authority to do that... but as the children had been moved they should stay with their dad til the final hearing when a final decision would be made. That gave SS more time to build a bullshit case that is full of holes, lies, lack of context etc. Regardless - a court said SS had acted without legal authority but no further action will be taken unless this woman makes that happen through the complaints system.
I happily let her mind my daughter. And while I used to be someone who always thought I would have no problem with SS, would never be afraid of them and would always co-operate (maybe that's my cosy middle class bubble), now I wouldn't let a social worker in my house without a court order or a police presence. And if it ever seemed that any sort of court order might be on the horizon I would be on a plane that day. Sounds dramatic, but when you have witnessed what I have you cease to have any faith at all in a system that I'm sure is largely effective and well-meaning but has gaping holes of incompetence, unprofessionalism and possibly even ill intent.