I think people get themselves quite confused about all the "love" stuff and the "being in love" stuff. For instance, you can "be in love" with someone and behave very badly. It is not necessarily a license to a good partnership. I think "in like" can work very well for long term relationships, there is not the earth-shattering emotional/sexual component but then that tends to fizzle after a bit in any case.
Men in particular seem to use the "I am no longer in love with you card" with gay abandon - without really thinking about the consequences of this kind of thoughtless comment.
In a way, all that is semantics - it is what people do and how they behave that counts. And that includes being thoughtful with regard to speaking about the relationship. If you make comments that can be construed as hurtful, then there will be a negative backlash. Why don't (some) men get this?
OP - sounds as though your partner has got issues which he is projecting on to you. That one infidelity for instance - how about "getting over it" rather than the obsessive not getting over it? That smacks of OCD not to mention other possible personality disorder type tendencies.
You can't change him so I guess it's a question of whether you are prepared to put up with his thoughtlessness for the sake of family life and whatever else you get out of the relationship (finances etc?) or whether, on balance, you would be happier going solo?
I personally would not have any kind of intimate relationship with a man who did not put a lot of effort, and kind words AND actions into the relationship. Perhaps I would consider a co-parenting type of situation where you agree to have other more fulfilling relationships while maintaing the status quo and marital home? He appears to be treating your marriage like a business partnership, so you should be free to have your emotional/physical needs met elsewhere.
I don't see how he can have it all ways. Call a few shots here - he doesn't own you, even if you do wear a wedding ring.