I love both.
I'd probably choose Olive, as Penelope seems to be increasing in popularity quite rapidly and I fear it'll become "trendy".
I would've had Olive on my list if we didn't already have an Olivia in the family. I love the nickname Ollie for Olive, rather than Liv.