This evening my husband suggested the name Olivia for a girl which I love also.
However, my husbands brother is called Oliver.
Would it matter? To me, I don't think it would at all, but I'm not sure if people (or even he) would think it's too similar.
Thanks