Me and DH, one child, live in a small but lovely little detached house with great neighbours. We both moved around a lot before we bought our second house so not an issue of having not lived elsewhwer. We've lived here for 17 years and I love it, quiet culture de sac, with my mental issues I feel safe, we are near to everything we need and want to be.
He's mentioned it a few times over the years that he would like to live somewhere bigger with more space and for him a joy to drive up to. (I find it a joy to drive up to, for him it's a bit more for show)
I do have a lot of issues with my OCD so a move would have to be worth it. DH always likes to be busy, have a project etc and feels restrained that we've done everything we can with our home, which doesn't have a garage or big garden to make him happy.
Yes I do think somewhere bigger with more space to get some personal space and do hobbies would be a bonus and I'm going along with it as long as it ticks both of our boxes. Problem is with the market now houses are so much more expensive and trying to find the perfect one isn't easy.
We are mid 50s and our mortgage is almost paid off. I was thinking oh great, kick back a bit, have more spare money and I will have more time to do the important things in my life like looking after family who need me, the responsibilities he doesn't have and yes I still work and will for years to come.
Sorry guess my point is...
AIBU - push yourself, continue to both work hard and take on a new mortgage to have more collateral and with it more space?
AINBU - think of yourself, make your DH understand and compromise somehow? So lucky to have a nice home, he's the one who doesn't have friends next door to chat with and wants to do solo activities to feed his never-ending need to be busy!