user1465649950 this sounds hard. Although I do not see he necessarily has a game here. It's really hard to see what is really going on as you are very nice about him, on the whole, but I sense there is more!
He didn't want a child, was upfront about this and is now dealing with the situation with you. Is he a good partner in other ways? This would influence me a lot.
"I'm aware I'm with someone similar (that's a load of other issues though)
And I don't want that for my daughter!"
What other issues? These are relevant.
If he is just a nice guy not ready to be a dad yet, then I really think I would cut him some slack here and stay together if you wish to for a while longer to see if his feelings for his dd grow. However, if he had other issues which are serious, I would seriously consider ending things.
It really sounds like his own dad leaving and having to help with his younger siblings has made him feel very unhappy/conflicted/unable etc to engage in being a dad now.
The only way he will really get beyond this is if he works these things out for himself and makes a conscious choice to move forward.
I know I say it a lot, but counselling does make a difference to how people see themselves and their lives and how they can move on. It is not cheap but what price could he put on knowing his daughter one day, or rather not knowing her!
He might be able to access cheaper counselling by offering to be helped by trainees on a counselling course, I believe as the counselors are in the process of being trained, there may well have oversight etc from experienced counselors, but do get him to check this.
If you are happy with him, if he treats you well and if you want this to work, I would personally give him some time to work this through and if he is willing to do this it would show you that he is serious about you (which could lead to him loving his daughter and developing a relationship with her).
Whether he stay with you, and you stay with him, or not, he can still consider counselling to move beyond these feelings about his daughter.
You are under no obligation, ever, to stay with him. You know this.
Keeping in touch with his mum and allowing her to be the grandmother she is, may help one day in facilitating a relationship between your dd and her dad.
Good luck. 