It’s such a difficult one and I totally understand your dilemma. I was 29 when I had dc1, 31 with dc2 and will be 32 when dc3 gets here. My life has changed so much and I do miss my old freedom, travel and just lack of responsibility for anyone other than myself.
My dh is a few years older than me so we decided to try to conceive straight after our wedding. We were in a 4 bed house and were married, the two things we said were a must before babies. This isn’t necessarily what everyone would want though. On paper, it was the right time. However, had I known how quickly we would conceive (1st month of trying for dc1 and dc2 and happy surprise for dc3), then I would most definitely have waited until I was 32/33 until we started trying. However, until you actually try and succeed (or not!), you have no idea if you’ll have fertility issues. We wanted time on our side to be able to get help if we needed it. Whilst I know that many women successfully get pregnant in their late 30’s and 40’s, your chances massively decrease with age.
I love my dc more than anything and had many years of fun before dc1 arrived, but selfishly, I would have loved more.
In your shoes, I would decide on whether your house is big enough for a baby or two. If you have 2 bedrooms, then you could live there until dc2 needed to go into their own room which is a minimum of 6 months. This means that you probably have a few years yet until you actually need to move.
I would say to take whatever trips you have your heart set on before children though. Holidays will never be the same and it’ll be 20 years before you get a holiday alone with your dp doing exactly what you want to do. Whilst there may be people you say would happily look after the dc when you go, a) you won’t want to leave them and be so far away you couldn’t get home quickly, b) you’d feel guilty about them missing out, c) you’d talk yourself out of it as there will always be something more beneficial for your dc to spend that money on.
Sorry, that turned into a much longer post than I anticipated 