No, you are not controlling anything at all here. But also, imho, you don't have grounds to be upset either.
You are in a dating relationship, even if exclusive... this does not give you rights to all of his time 24/7 iyswim. If you were living together, there may be a raised expectation of participation on the homefront, chores, childcare, etc. But he would still want to nurture his relationship with his child, and again imho, I do not see how you would figure into telling him rules for his relationship with his child. (That kind of sounded harsh, and I did not mean for it to, sorry.)
This is a circumstance, baggage, that comes with this fellow. It does sound like he spends a lot of time in the presence of his ex. I would not feel comfortable with that either, especially sleeping over. He can talk all day long about convience and trust and cost and on and on, but the action speaks volumes.
No, he does not tick all the boxes or you would not have this cloud of doubt hanging over his choices. I would approach this relationship as a casual affair and not get dependent on him in any way, if you like being in a relationship but do not necessarily need or want a man underfoot. He may still be emotionally invested in his ex, despite the volumes of scripts men have at hand to convince otherwise. If that is the case then you are like an affair on the side, just not technically the OW as he is divorced...but perhaps you are beginning to feel the dynamic is the same.
If so, then it might be time to think about calling time and become available for someone without such consuming circumstances regarding dc from previous relationships. What does it boil down to? If you are not happy, then you are not happy. Please do not ignore that.