Oh come off it - that doesn't make it any better. He's just trying to cover for the massive gaffe, "Ooh, I definitely saw some men earlier, though. Honest".
And it's still obscenely tactless to ask a group of women whose husbands may be dead where they are.
And of course the women can't show offence: he's probably about to be FM and they are refugees.