I think Florence is perfect with Samuel, Rose and Elisabeth. Matilda also works very well with them.
I can't believe your husband rejected all those names! He must be very picky.
I haven't combed through to make sure I'm not repeating but I'm giving some suggestions I'd call unusual but still classic in the hope that some of them might not have come up yet:
Aurelia, Anastasia, Amalia, Ariadne, Alessandra, Antonia, Aurora, Bronte, Cordelia, Calliope, Clarissa, Constance, Diana, Fenella, Georgette, Henrietta, Harmony, Isadora, Isolde, Jacinta, Jocelyn, Larissa, Lorelai, Miranda, Millicent, Melisande, Naomi, Octavia, Persephone, Philippa, Rhiannon, Sorrel, Saskia, Tabitha, Tamara, Vanessa, Verity, Xanthe, Ysanne