Nutty, this is one which has been troubling me. I could probably afford to move if I moved somewhere away from here. But it would mean moving away from my parents and sister. I was never close to my grandparents until the end of their lives, and I regret that. I decided that it's more important for me to sustain the relationship between my parents and children, at the moment they are very close.
But it is a very personal decision, and obviously I don't know all the details of your situation. I would just say follow your heart. I would guess you don't have to make a decision right away? And presumably it would be reversable? Give it some time before rushing into a decision, but really, follow your heart.