Let me first say, I don't think you should be allowed to visit your second holiday home abroad.
Second, if you have family abroad - it would be nice but it's not a right to see them or for them to visit you. You made the decision to move to another country so if rules change for whatever reason you have to abide by them.
A few years back my DGF (Luxembourg born, grew up in Germany and moved to UK as a young man) couldn't return to Germany much (where his family lived) to see his family. This was after WW1 and before WW2. He certainly didn't return to visit Germany once the Nazis were on the rise and he only saw his DM and 2 DB's when they moved to UK (they had dual English/German nationality from their DF, if I recall correctly), part of his DM moving to UK was to look after her grandchild, my DM. They all had to rely on letters, phone calls and telegrams, no zoom calls then.
At the moment it'll have been a year and a half so far or 2 years where you won't be able to visit family abroad but after that, you will probably be able to do so.
I have one friend so far (Polish) who for various reasons has decided to move back home and to see/care for her DPs and a Spanish colleague of mine has temporarily moved to Spain to live with her DPs. Other colleagues left the UK to return to NZ/Australis to live and work but they may have chosen to do this anyway due to work. Another friend of mine who's French would love to go to France to see her DPs and family but she told me it's too expensive and with the rules also not possible yet.
Holidays abroad of course shouldn't be allowed and I'm not going on one - didn't do so last year either.
As Nith says if you choose to live in a different country then you limit your own right to family life and that should not trump the right to life of everyone else.