OP, I completely hear you.
We lived abroad for many years and then returned with young children so we could be near GP's and other family. We got that phrase and another on top. There is one of DH's family member who constantly told/tells me "If you live abroad, you can't expect to have the same relationship with family as the others". That may be true, but don't need telling it every 5 minutes.
We moved back with our DC, and deliberately moved close to one set of GP's. Then they upped and moved away.
It was OK when we were providing a free holiday home, paid for holidays, paid for all the food and drink and excursions and sent lovely Christmas and birthday presents though.
We have had zero help from either side of our family since being back, and at times it has been very tough as although we moved back, my DH retained his old job and has to work away a lot.
The most upsetting thing for me was my nephews wedding. When he was small I used to look after him all the time. He got married and me and my DH and DC were excluded from the photos. We were the only family that was not in it. Even girlfriends and boyfriends were in them!
Unfortunately living abroad and having that experience, and often coming back with a large wad of cash, has it's sacrifices. One of them is family often carrying on the "hump" that you went away, and then came back quite flush.
In the end I made great friends, and they have been my saviour. Also, we people have "our own lives" too. Accept it, carve out your own joy and leave the door open, but don't wait around for someone to throw you a fish.