'When DSD first moved away we had a row and he told me that 'I might as well pack my bags, quit my job and I move nearer to my daughter.'
- a brilliant example of what I said upthread.
Basically, this tool does not care about either child, really. However, what he does like and finds very useful in his relationship with you is to use the fact that he has another child as some universal 'trump card'. So you have a row... and his way to go on the attack is 'Aha but I'm a father - a poor, absent, worried father - to another child you know! I have TWO children! More on my plate than YOU! Look, there's this big extra THING in my life that you can't possibly understand!'
And again when you were pregnant, and had your baby, Mr. Childish and Lazy didn't like the thought that he (partly by his own uselessness) was somehow in the background. He could have thrown himself into being a new dad and caring for the baby with you... but that would be hard work. A much easier way to somehow 'trump' you again, at this special point when all the attention was on you, is to use his ace card again. 'Ohhh, but I've done this before. And of COURSE it was sooo much more important/special/nothing ever comes close! What do you mean, fatherhood can't be that special to me because none of you ever see me lift a finger to help? Umm, I'll tell you why I'm less involved here, it's not because I'm a lazy feckless shit, oh no, it's because, umm, hang on - it's because she's not my FIRST! Yes, that's it! Ohh, you couldn't possibly understand, ooh, when my FIRST was a baby, I did everything, I was super dad, it's different now because second children just aren't the same. She's so special to me that I let you do all the looking after her and can't even be arsed to sort out her rotting teeth and, oh, um, hang on...'
Stop listening to a word he says, OP. He doesn't love your daughter because he loves nobody but himself. His first daughter wasn't any more special, that's just a stick he uses to beat you with - while you wash, cuddle, care and feed her and see her shipped off to her gran's the moment you leave. Yeah - she's so very special to him. Ignore him. He is worthless.