I think it's unfair jumping to conclusions about the father.
It seems she moved away. It's also likely that the children suffered earlier abuse which she may have blamed on him.
Or just refused to let him see them, incase he found out about more abuse.
I think it's quite unlikely that he knew enough to complain to SS (correctly) but just couldnt be arsed seeing them.
Whatever happened, this woman is evil.