And if he blames you for his choices, here’s a Q/A from a website called “Emotional Affair Journey”:
Hello!
Question...
Do you believe that there is any truth in feeling or thinking that our partners can be driven to have extramarital affairs by our being abusive or not reinforcing their feelings?
Response...
While "being abusive or not reinforcing their feelings" can certainly lead to legitimate dissatisfaction with the marriage, it can't "drive someone to have an extramarital affair."
Having an affair is only one of many ways of reacting to this kind of situation. Other alternatives include: insisting on being treated differently, insisting on counseling, or leaving the marriage.
Of course, this kind of situation may lead someone to think of having an affair or want to have an affair. But we don't do everything we want to do.
Regardless of why someone might want to have an affair, they're unlikely to actually do it unless they're willing to be dishonest and deceptive. So the real reason they have an affair is because of this willingness to deceive.
The bigger issue underlying this question, however, is the tendency for someone who is having an affair to blame their spouse for it by saying "you didn't meet my needs."
Frankly this whole idea that affairs are due to a failure of your partner to meet your needs simply adds insult to injury.
So while "being abusive" is a serious problem and definitely calls for taking some kind of decisive action, having an affair is not a reasonable action to choose.
So whatever you decide, whatever he says, don’t be tempted to blame yourself or the lack of sex. It causes marriage issues, absolutely, but not facing these issues, plus a willingness to act selfishly and deceive, is what causes infidelity.