If it was over, you should never have come clean. Unburdening your soul means you crushed his.
This is one guilt that you should have carried in silence, alone. You were a damn fool but it wasn't for long.
My advice to you? IF you want to heal your marriage and stay married? IF you still do love him?
There is a book by Linda J MacDonald called 'how to help your spouse heal from the affair'.
From the betrayed spouse point of view, here is what I needed:
Your hating yourself and feeling sorry for yourself is all about you. Actually, you need to think about him and his hurt.
You cannot say sorry enough times. Try and say sorry before his comments. Try and pre-empt his pain.
The comments are from his pain and that he is trying to get across to you how much it hurts and how much damage you have done. So, apologise, acknowledge how selfish you were, how you weren't thinking about anyone other than yourself.
Talk about how ashamed you feel, how you fell for the flattery, how it was a fantasy, if it makes you feel unworthy, less than etc. That he was a stranger, you were pretending, blah blah blah.
And bring it up BEFORE he brings it up. This is the absolute key thing to do. Because it shows its on your mind and how much you regret hurting him, breaking your bond.
Last of all: try and go back to the beginning when you first met, and getting to know eachother. Talk and talk and talk. And touch him. Not sex, but just touch him in a respectful and caring manner. Hand on arm, etc.
That is what will heal him.
And you do it for as long as it takes.
If you don't love him, don't find him attractive any more, then as other people say, rip off the plaster.