Upmarket but not lux holiday destinations?

[gardaynia]

Can anyone think of some nice upmarket feel holiday destinations? We don’t need luxury but don’t feel relaxed in mass market destinations.

I think a good example would be somewhere like Anti Paxos or Patmos in Greece, bits of Menorca, or at a push somewhere like Padstow

Quite a few of mine have already been mentioned here but to add a few more Comporta, Port Soller, Brac, Cap Ferret (not Ferrat)