Just posting, because I totally get where you're coming from. I think my situation might be slightly different to yours, but it's very irritating nonetheless. My DH always has "stuff to do", so we can't go anywhere/visit people etc. But to me, there's always "stuff to do" and life's too short and the people we love won't be here for ever, so we need to visit them. For me, life needs to be lived and enjoyed NOW.
When the kids were younger, I always took them out to play parks, soft plays etc on my own, while he stayed at home to "get stuff done". With my family, I just visit them on my own (with the kids), my DH only comes if it's a big event (wedding/funeral).
I'd love to see HIS family more, and would love our kids to see them more. His Dad is lovely and getting very old now, so struggling to drive up to us, but every time I suggest that we go to visit him, I just get "I'm too busy, I've got stuff to do". To be honest, I don't mind doing all the organising (especially holidays), but on this one, I don't feel I can go over his head and organise things, when it's HIS Dad.
He even has a hobby and for years I organised everything for that as well, but when the DC came along, I just didn't have the time, so I stopped, and interestingly, he maybe does this hobby about once a year now. I'm convinced he's just not that bothered about it, or only is if someone else does all the leg work.
I enjoy going out for meals, but now I just go with the DC, because it's more enjoyable - if I force him to go, he blatantly sits there itching to get home to "get stuff done".
I have sometimes wondered if he's very stressed or mildly depressed or both, but when I suggest that to him, he just insists there's nothing wrong with him, so what can I do? I get the impression your wife is happy with the way things are? Whereas I'm not convinced my DH is actually very happy.
Sorry, hope I haven't hijacked your thread, but your post really struck a chord. I don't actually have any advice though! I'm watching closely.