You & DD don't seem to be included in anything, so it's about context of whole relationship for you. That's how Im reading it. It sounds a lonely relationship.
H works away barely sees wife & child, and on a weekend off wants to spend it on a 'no partners' break with family?!
Why no partners do they think they're Lads & Ladettes? Is it about 'getting away from partners' (those pesky people) for a bit? Only he's well away from you already isn't he so, what's to get away from?
Why when he barely sees you and DC, can he not book a weekend away the 3 of you together or if you can get childcare, just the 2 of you - or even, horror of horrors, spend a weekend here with you, perhaps drive to somewhere pretty and chill out?
Of course couples can holiday separately, I holiday with DP yearly, then normally me & mates will either do a Europe long weekend or week. My parents live 5000 miles away abroad so there are times I go off to see them too, sometimes DP & DC join me, sometimes they don't. Went with a friend in June.
A relationship is not a relationship if 1 partner simply isn't present. How can you bond in a relationship if he's not around? Your life moments are separate
Money isn't everything in a relationship. It doesn't have to mean everything to you. Re your H, working is no excuse to be living what is essentially a single life, when you're on longer single you're married and that does entail compromise and some changes.
As uninteresting as that may sound, it is what it is, you can compromise without being welded at the hip, but mega-distance isn't conducive to a good, lasting relationship.
I'm trying to work out from your post whether this man does any childcare or has 1-1 time with his own DD. Doesn't sound like it.
Is he running a country? 🙄