As a rule of thumb/best 'practice' type approach, all food should be defrosted in the fridge, although especially meat, which I know isn't relevant here.
Saying "I've never get ill"/ "no-one's died" isn't really relevant; you increase the risk by defrosting in room temperature, not guaranteeing you'll get ill, so good for you if you haven't, but that's not proof of anything.
Anyway, unless you're cooking for paying customers it's your choice what you do - I've, through various jobs, completed numerous food hygiene training, but absolutely don't follow it for myself.
However, and getting to the point of this thread, your DH isn't being ridiculous because he doesn't want to eat it. You may feel he's being a little irrational, but good grief, everyone has things they'll appear irrational to others about, and if we all got ridiculed, called absurd or demeaned for them it wouldn't be a particularly pleasant world. So, you're BU