I'd say if you both love it, then go for it @jennifersarah. It's also the name of the Dr chap who won the most Victoria Crosses in the First World War. Noel Chavasse. He died from his wounds after continuing to rescue his men from No Man's Land and treat them, despite being injured himself. And of course there is Noel Coward the composer/playwright and Noel Streatfeild (female) the well known children's author of 'Ballet Shoes' etc.
We like similarly unusual, but hopefully not too unusual traditional kind of names I think. Have you thought of Gilbert, Walter, Wilfred or Alfred?