A good way to answer the affordability question is to ask a very different question to 'is it possible?' If you can find out the areas where a lot of English people have moved to, and cross-reference that with how much tourism there is in the area, you'll be on your way to an answer.
And it isn't that English people aren't nice, they're perfectly nice. What it is, is that the houses they buy were probably once someone's parents' or grandparents' house, and those folk can't move back because they've got teenagers in school or they can't do their job in that area, so they sell (of course) to the highest bidder. And all it takes is a few people to die in a village and a lot of new people to come in, and the existing population feels they've been supplanted.
The thing is that when you live in a bigger population, you see easily that there's a lot of movement, and nobody bats an eyelid. But if you live in a place with 400 people, it doesn't feel like people move around at all, it feels like people stay and that's what the focus is on.
Then if you cross-reference that with the areas where there's a lot of tourism, that's a double whammy because as well as houses going to incomers, some of those houses will be put to holiday homes, and prices go sky high, and there are too may tourists for the roads to cope with or the services to cope with, and it all feels far worse.
So basically, if it's an area that's higher populated and not touristy (most of the central belt? Fife?) it will feel easier to move to it. If it's an out-of-the-way place and has a busy tourist summer, it's pretty delicate in terms of how to behave so as to fit in, it's a real learning curve and an exercise in forbearance and humility. People do do really well at fitting into the community sometimes, but I've seen some total disasters too. Any rural Scot has a list of things that have been said to them that are completely outrageous and show no understanding of how life is there. I'm one of those, but I moved away. I'm so tactless, I wouldn't last 5 minutes in a village now haha.