Okay, here's your problem.
By the sounds of things, you don't actually know that he chose to be with you because he loves you and didn't want to lose you. Is it possible that you haven't got the whole truth about how their relationship ended? Is it possible that she dumped him and moved away - and this prompted his decision to stay in the marriage?
This would explain a lot. He has never fought to keep you and it almost sounds as though he feels you should be grateful that he stayed. How much respect has he got for you, I wonder? This really doesn't sound like a man who is scared that he might lose his marriage because of his behaviour. This doesn't sound like a man who is truly sorry.
This is further backed up by his behaviour since. You say he won't go to counselling? You say he reacts angrily when you raise the issue that is absolutely consuming your life - and says "why do you have to analyse everything?" You say he won't talk about emotions.
And to boot, he works in a nightclub 5 nights a week and by the sounds of things, intends to continue working at the very place that was centre stage for his affair.
No wonder you're in bits. You don't have to forgive you know - and you don't have to stay in this marriage. It doesn't sound as though he has done one thing to fight to stay in it either. Rather, he gets irritated by you.
You are right to be analytical. The fact that he doesn't want to re-visit all this and analyse his own behaviour means that there's every chance this will happen again. No analysis means no lessons learnt.
Now being blunt, either you roll over and accept this, along with what sounds like a total lack of respect for you, or you start getting tough and insisting on change.