Oh sweetheart, I am SO SO sorry he has ruined (or at least has tried to) such a special time for you by being so outrageously cruel. He is supposed to be a grown man right, but his behaviour, attitude and now, the vile remarks, indicate that he is anything but.
You are being very brave to have shown him the door. Many women would have swallowed the hurt and insults because they felt so vulnerable at a time like this.
I don't know what will happen long term - for now, you obviously need to concentrate on doing what feels right for you ...... sod him, looking after no. 1 is all you should be thinking of right now. However, I can't help thinking that if he is so obsessively blinkered about his DD - to the point of callous ridiculousness - that perhaps you are better off without him ? If he is willing to disregard your physical, practical and emotional needs at a time like this, when you needed him most, then what would he have been like on an "ordinary" day to day basis. I can't help feeling that his 1st DD would be significantly favoured over his 2nd child, if he can behave like this now.
Obviously, you'll have some sort of bond together going forward by way of the child you have together ..... but I think I'd rather bring that child up on my own (with regular contact with dad) than have them exposed to feeling they were regarded as inferior to their sibling on a daily basis. I can also appreciate that you must be feeling shell-shocked at being regarded in the same manner (inferior) compared to a child. Not that it's the child's fault .... but all this was totally avoidable and 99.9999% of normal men would have avoided it without question as the decent thing to do.
I am furious that he has tried to make you feel guilty and like some sort of wicked stepmother for objecting to this - wrong on so many levels. It's not like you're stealing the food out of his child's mouth, or demanding he stops seeing her. I truly think this "man" must have very serious issues to be so disgracefully cruel and obsessed at a time like this - it's not normal and it's not healthy. He is utterly contemptible.
IIRC, you don't have any family nearby ? Please consider calling what family you do have, and who you are close to, now all this has happened ...... I'm sure people will rally round to help you if at all possible. It breaks my heart thinking of you labouring alone. Do you have any friends who could accompany you instead ?
Damn ..... typing "good luck" and "best wishes" seems so futile, but it's all I can do .....