There seems to be a real trend these days (at least on Mumsnet) for names which, not long ago, were the preserve of the aristocracy, or the eccentric. During my childhood, in the 1970s, eyes would have been rolled at Peregrine, Monty, Persephone, Anastasia et al.
I'm very much of the view that you do as you like and ignore the tastes of others. However, if you are at all concerned about the impression a particular name gives, you need to bear in mind that "out there" names can label a child. On the one hand, unless you obviously come from a long line of Peregrine type names, certain people will see your choice as very "try hard" and that could reflect on your child in years to come. Another possibility is that your chosen unusual name could become popular, possibly because aspirational parents choose the name, too. I think that has happened to an extent with names like Archie, Finn and Amelia, which are now very mainstream, but were definitely more aspirational 10-15 years ago.
All of this is very politically incorrect, I know, but if you are concerned about the impression a name might give, you need to consider it and decide if it bothers you. I don't think it's a coincidence that most genuinely aristocratic families use ordinary, traditional names for their children.