Sweetheart I have no wish to cause you further upset but you are being treated appallingly.
How arrogant after causing you extreme pain to say that he likes what he has "here" and doesn't want to leave. Where do you fit into this scenario ?
It is unrelaistic and cruel to forbid you from discussing his affair ..... are you supposed to shrug your shoulders and get on with it as if nothing had happened. Sounds to me like he is NOT sorry, that he doesn't think he's done anything wrong and doesn't want to be (in his eyes) "nagged". That is, as far as you and your feelings are concerened - contemptuous.
I'd bet that most couples who've actually survived an affair have only done so after a hell of a lot of gut-wrenching, hear-breaking discussion. The guilty party may not wish to rake over stuff but that is going to be a necessity for the innocent party. On top of that, there will need to be a lot of frank talk about why the affair happened ..... it's rarely as simple as being opportunistic, and usually indicative of problems in the relationship - even if they are painful to confront, it needs to be done before they can be resolved.
I don't - and can't - believe for a second that couples who get through this merely act as if it never happened at all. That state of things would tear most people apart - especially, I think, the so-called innocent party .... and I also think that it'd also indicate a very unhealthy balance of power between them, with one person dictating what is and isn't permitted to be spoken about, and one person believing they are somehow entitled to behave badly without any remorse, reconciliation or attempt at explanation.
I think, FWIW, that living like that would drive me, quite literally, to a nervous breakdown in a very short space of time.
I really do think that the pair of you need to go to RELATE or somesuch, but guess that if he doesn't want to talk about it, that's a no-brainer to start with ?
Personally, I would find it difficult enough to regain trust and be affectionate even if we did go through counselling - without it, there's no way I could ever trust the man again. With an attitude like that he is effectively saying that your feelings are worth jack shit - that the only "important" person in the relationship is him. I suspect that at that point any residual feelings I had left (which would have been very sorely tested by the affair) would actually turn into hatred for someone who dismissed me - the mother of his kids remember - so casually and hurtfully.
Surely you deserve better ???