I’m wondering why you married him in the first place, because this doesn’t sound like it’s just about one comment.
The biggest red flag is him saying he “would have found another woman.” Even if he now says he meant something different, it’s a deeply hurtful thing to say and it’s understandable that it has left you questioning his motives.
What also stands out is the lack of respect he shows towards your family, despite everything they did to help him. Rather than acknowledging their support, he criticises them and then accuses you of being disrespectful when you defend them. That’s turning the issue back on you instead of taking responsibility for his own behaviour.
You’ve also described him having very rigid ideas about the roles of men and women. If one partner believes men and women have fixed roles and expects those views to dictate the relationship, that can lead to an unhealthy imbalance.
Calling women “harlots” is another major red flag. It suggests a lack of respect towards women and a tendency to judge or demean them in ways that most people would find unacceptable.
Taken together, this doesn’t read as an isolated argument. It sounds like there has been a pattern of disrespect, controlling attitudes and misogynistic views that you’ve perhaps overlooked until now. The comment about “finding another woman” may simply have been the moment that brought all of those concerns into sharp focus.
I’d be asking myself not just what he meant by that one sentence, but whether this pattern of behaviour is something I’d be willing to live with for the rest of my life.