I would move.
I lived in a small village, in a house that I loved, but at some point we realised that in the three years we had been there, only 2 times friends knocked at the door when not expecting them. I think that although the location and house were great, the experience was quite isolating.
We moved to a bigger house (although we were prepared to downsize), in a good area that was far from being as pleasant as the village, and everything seemed easier: easier to pop up to the shops, to have friends around, to be more spontaneus about going out, now walking or cycling to work, and the best bonus... wonderful neighbours.