@crumpetandcoffee I'd definitely consider selling up to be mortgage-free, but you obviously need to think very carefully about where/what you buy next.
Somewhat like @thisoldcity we've previously sold three houses that we'd rather not have done (#1 - at 3500 sq ft - was way too big for us when DS went to uni, plus our mortgage was 2k+ per month, the other two were #2 my favourite house/but wrong location and #3 DH's favourite/but thatched) and more recently we sold/bought again, moving from a house we'd painstakingly restored (but didn't like) to one closer to family.
We've been mortgage-free since selling the 'big' house and it's made life so much less stressful. However, both of us still - admittedly ridiculously - pine a little for our favourite houses.
Last year we sold the property (a characterful old mill in rural Wales) that we'd purchased as a run down repossession six years previously. On paper it was a great home with a 0.5 acre garden we'd created from scratch. But we both utterly hated living there and missed our family terribly, so selling that one was a no brainer. We needed to relocate to a more expensive area (south coast of England where we're both originally from), so knew we'd have to compromise loads, but also recognised we wanted to be back near the sea, preferably in a period house.
We found a location we liked, but sadly couldn't quite afford the brilliant project cottage two minutes from the sea that I adored. Instead we purchased a smaller cottage literally round the corner that DH persuaded me I'd grow to love. It's about one minute further from the beach, but despite being Georgian had absolutely zero period features. I really don't like it at all, but we're throwing everything at it (our modus operandi 🙄) and if I still don't love it when we're done, he's agreed we'll sell and move again. I really can't face another (DIY) project and would much rather we'd stretched ourselves to buy the other one.....
So, whilst compromises have to be made and expectations managed, if at all possible please don't buy somewhere you don't both feel at least a little bit of love for!