If she saw him in person and was held by him, she'd get to know his smell, his touch and that's an important part of bonding for a baby.
But he needs to be the one that comes to visit, not you going to him while she's so small.
Seeing his dad isn't a reason not to facetime for a few minutes. What he hasn't got hold of, is that the contact is for her benefit, not his.
When you facetime, make sure that you're not in the video, and have headphones in listening to music. Only intervene if she gets upset, or it he gets inappropriate (anger or comments to you). As he may be try to use it to control you either now or in the future. Setting healthy boundaries now will help you in the future.
Also, don't talk to him on the phone or via facetime yourself, except for the quick "right here she is" type of thing; make sure everything is via text, message, or email so that you have everything in writing. If he tries to talk to you, tell him to text or email you, and if he persists, tell him you'll have to end the call unless he stops. And if he carries on, end the call