People who own second/holiday homes pay council tax. They aren't freeloading.
In our case we also employ local tradespersons, patronize local shops and otherwise contribute to the economy.
The notion that an individual or family should only own the home they actually are residing in, is absurd. Seasonal properties are a not-uncommon way of life in most parts of the world.
I agree there should be more government underwriting of affordable housing but certainly not any curbs on how many properties an individual may own.