This is always such a tricky question and my answer has changed over the years.
So a few years ago we decided we wanted to buy, but we didn't want to be mortgaged to the eyeballs, holidays and treats were important to us. So we bought a small 3 bed as our first step on the ladder (with 2 kids).
A couple years later and the treats just aren't making up for the fact the house is simply too small. We knew this was a stepping stone but we've grown out of it much quicker than I hoped. So we need to move. The compromise we've tried to make so we can still have one holiday a year but so we have a big enough house is location. We aren't from here so aren't particularly loyal to a location, but we are moving about 20 miles away to a less desirable town (but has good schools) to double our square footage.
Our priority with our first house was location, we loved the school and it was good for work. Now I work from home more and my DH has a lot more flexibility, we can be more open minded, so location has actually dropped down our list. We have lived in several places and know we can make the area work, from rural idyl to city living, we've always just made it work, so long as it is safe and has good schools.
This time house couldn't be compromised, it's the forever home. My husband is a petrol head, he wants a double garage and a room for himself (man cave, sorry for the cheesy terminology!). I wanted bigger rooms for the kids and an office space for me. Detached. So for us to get this in budget, we've moved. Our budget has increased, but we can still have a holiday every year which I won't give up, some fun money for ourselves. We've also decided to get help to buy, I know this isn't a decision that would suit everyone, but for us it enables us to get to the forever home quicker, makes our mortgage more affordable so we don't have to adapt our lifestyle too much, and I am quite confident we will be able to remortgage it out eventually. We had children relatively young, we have plenty of time to over pay the mortgage down the line (and good insurance if anything happens to scupper that!) sometimes it is about taking risk and weighing up what you're comfortable with, we are still relatively new in our careers on good trajectories.
Lockdown has certainly exasperated the desire for a nicer home too.
Not sure if that helps!