You need to come to grips with the fact that you chose to stay, at least for that time, in a relationship with someone who didn't want to marry you.
You need to come to grips with the fact that you chose to stay, at least for that time, in a relationship with someone who wasn't willing to stay home every/any night for you.
You need to come to grips with the fact that you chose to, or accidentally ended up, having a child with that person.
You are annoyed he is doing as he pleases, because you are annoyed he didn't want to please you.
But you are totally missing the point, which is that he is allowed to turn up for his child, it's good that he's turning up for his child, and you don't get to dictate how or with whom he does that.
You couldn't even get him to do what you wanted while you were together, so it's really really pointless to expect or hope you can do so now. Now, he effectively doesn't owe you any of that stuff anymore! Frustrating because of past (real or perceived) slights I'm sure, but true nonetheless.