I find it quite irksome when men say hurtful things and women try to explain it always by saying he was 'clumsy' or 'misspoke' but meant no harm.
Firstly, its untrue. Men generally aren't as inarticulate as a lot of women try to convince themselves and each other they are. Much like women, men tend to say what they think. IME, when men make these sorts of comments, it's because they're expressing their thoughts.
Secondly, it's really dismissive of the hurt these words cause.
I've said to my husband about a single friend of his who has come up in conversation - he's a good looking bloke and I'd imagine a lot of women would find him attractive. That's not the same as asserting every woman would want to be with him because I'm part of 'every woman' and I don't so its not true.
If the OP's husband had said, "She's an attractive woman. I'm sure she'll be fine/plenty of blokes will be attracted to her," etc, he wouldn't have been implicitly including himself in that number.
It reminds me of when I was single and I was talking to a married friend and her husband and she told me (in front of him) that he'd said if anything ever happened to her, he'd marry me. Aside from the fact it was all kinds of wrong, I just thought it was really odd that she'd be ok with that comversation.
Only i realised that she wasn't. Because she flirted with every married man in a 10 mile radius and, when I did start going out with someone, she flirted with him so outrageously that I walked away from the friendship.
It's one thing to acknowledge someone's attractiveness neutrally. It's quite another to imply that you fancy them.
I do agree that the comment he made previously about the other friend was objectively worse though.