I think they are both lovely, but I would chose Imogen as there is really only one way to pronounce it. How about Imogen with Esme as a middle name? It flows beautifully, you get to use both the names you love and you don't have to regularly correct pronunciation.
My DH and I both have names that are often mispronounced. It does get annoying.