"But by then the community will have been destroyed" - I am from and live in a popular tourist area, we have a strong sense of community and that is made up of locals and non-locals. The non-locals, whether they have moved here to retire, to work or have a second home, are part of the community if they make an effort not to come in all guns blazing telling locals what they should and should not do. Looking at the non-local who has moved here, joined the parish council and says only vegan food should be served at the meetings - the majority of the rest of the council being hill farmers.
We welcome a new teacher who because they sold a house in a part of the country which is far more expensive than here, purchased a chocolate box cottage in a very desirable village and her job means the local school can continue to be open following the retirement of the 2 other part-time teachers.
We welcome the second home owner, who has offered to help the parish council (for free) in a project which requires a surveyor to be on board.
If we had not welcomed or alienated those non-locals the local community would be worse off.
It is not a black and white situation, you cannot stop people buying houses or selling them at a price both parties agree to.
We have s106 housing which does not sell, why? The younger locals do not wish to work in farming or tourism, so they move to areas close by to work in their chosen professions.