If you like it then use it. Our son has an unusual name and we were careful not to mention it to anyone once we decided on it until he was born because we knew it would divide opinion.
once the name is not theoretical and is instead how you are introducing your baby, people will warm to it. If they don’t, then that’s their problem :)