Blimey, this is ridiculous. A few years ago people would have told you that Elsie was an old-lady name and you were setting the poor kid up for a terrible childhood.
(Perhaps even the very same people now declaring that you can't possibly give a child a name they already know three of)
I have one son (22) with a perfectly normal name that in the under-25s is relatively rare, though in my early life I knew several bearers wherever I went.
My other son (18) has a perfectly normal name which was then massively and still is relatively popular, though in my earlier life I knew few and it was considered a bit (whisper it) Oddly Posh.
Neither has ever had an issue with their name. Both have been shortened on occasion (teachers would always ask S1 what he preferred and he'd shrug; friends as and when it occurred to them).
If you like a name, use it. (unless it's Margot or Imogen. I Have Views)