Albert - not overly keen but it's ok
Arthur - really don't like it. Do quite like Artie though (in a v posh way!)
Ernest - agree with your DH, don't like this at all
Hugo - don't like it, it has a gutteral sound to my ears
John - very much like it. Traditional, solid, classic
Felix - love it. One of my favourite boys names
Edward - Really like this and think it is perfect with George
Girls
Henrietta - Like it but it's very long for everyday and don't like Hettie
Elizabeth - It's ok. I'm always a bit meh about Elizabeth. Also don't like Lizzie, Betty, Betsy or Libby
Camilla - Like this. Only know two - one child and one adult.
Edwina - I actually hate this, sorry! so harsh and 'weeny' sounding
Audrey - really don't like this either
From your list I would choose Felix John and Henrietta Elizabeth I think.
Other old fashioned but slightly quirky:
Alistair, Abraham, Benedict, Cuthbert, Donald, Eustace, Edmund, Frederick, Gabriel, Hugh, Josiah, Jeremy, Leonard, Moses, Nathaniel, Patrick, Simeon, Theodore, Vincent, Walter, Zebediah
Anastasia, Arabella, Araminta, Bridget, Cecilia, Christina, Dorothea, Eleanora, Florence, Georgina, Harriet, Juliette, Jocelyn, Josephine, Louisa, Lydia, Liliana, Lucinda, Miranda, Miriam, Martha, Nora, Octavia, Penelope, Polly, Rosemary, Rosalind, Selena, Tabitha, Veronica, Verity