SIL was having trouble conceiving and went for all kinds of tests, whilst her DH was guilty of sitting ever so smugly back saying 'well, I've got 2 kids already, there's nothing wrong with me'
.
When she got the all clear, he went for tests and it was found that he had almost zero motility and 'no chance' of fathering children.
He didn't turn on his first wife and accuse her of cheating, or question his first two children's paternity. He accepted that between his first marriage breaking up and meeting SIL he'd gone a bit mad on the disco biscuits and booze, and also was now in his mid 40's.
They were told that ICSI was their only hope, and luckily they conceived a child that way. Whilst considering whether they could afford another round of ICSI they weren't using contraception and their second child (that they'd been told could not happen naturally) was conceived.
I'm so sorry that you've been landed with this horrible news, OP, and also had to put up with your DH's suspicions. Having suffered infertility as a couple I can understand the hurt and sense of loss you must be feeling, and to have to deal with his reaction on top of it... I'm afraid that I'd get shouty. Yes, he's no doubt hurting, but to turn it around on you like that shows a marked lack of sensitivity on his part.
I don't accept that it's because he's a man either, it's bloody insulting to men to suggest that as a sex they're all emotional incompetents who can't deal with any question mark over their masculinity. Agree with garlicballs - why is it her job to smooth over his hurt feelings and ignore her own in the process?
OP, YANBU. Infertility puts a horrible strain on a couple and talking things out could help both of you to sort out your feelings together. I would confront him, tbh, and not suffer anymore of these comments - if he says it again I would ask him exactly what he meant by that and does he realise how bloody hurtful to you it is? Possibly he's so wrapped up in his own hurt that he hasn't considered your feelings and it may help him see how ridiculous he's being. Or maybe he's just an arse. Only you know.