I get it rather. I'm against second homes too because quite frankly houses are supposed to be a home for people to live in, not a cash cow that invites other wealthy people to come pretend they live somewhere pretty for a weekend then stays empty most of the time.
I live in an area riddled with empty homes. It has wrecked the community, and because there are so many, there are virtually no shops or cafes left now because there's no one around apart from on hot bank holidays when all the wealthy tourists arrive with their huge cars blocking all the roads.