YANBU. And this is the reason why it's a risk marrying and having children with someone who doesn't live close to where you live. Doesn't have to be next door, but at least within an hour's drive.
I have known a number of couples who have lived far apart (they met on holiday, or whilst working abroad or in London or something like that,) and in 3 out of 4 cases, the relationship has barely got past the 1st or 2nd hurdle. It's just too hard, because both people want to live near where they grew up (and their family.) Only where one person in the couple is not close to their family, does the relationship work.
I may sound like a negative cynic, and some will disagree and regale me of their stories of how their relationship worked, and they have been married for 20 years, even though they are British, and their husband is from Australia, but IMO, it's difficult to maintain a relationship long-term if you are from completely different places, particularly if it's different countries.
I literally have no advice sorry OP. Maybe someone who has been through the same can advise you better. But no way in hell would I be moving down south. I live on the cusp of the Peak district, and it's the most lush and beautiful place, and the people are amazing. No way would I be moving south.
My family is here, and my friends, (old and new,) and my whole life is here. Even my adult children moved away for 4-5 years (3 of the years at uni,) and they eventually came back, and settled with someone just 20-30 miles away.
Wild horses would not make me leave. I have travelled a lot (to 20-odd countries,) and have no need to move anywhere else. Everything I have is here.