I hope you don't take him back. He tells you he has finished with the OW, but how do you know? He's lied to you before, he could be lying to you now. Even if he has finished with the OW how do you know he won't go back to her once he has wormed his way back into your life.
If you took him back, you would constantly be checking up on him, worried every time he went out torturing yourself if he is with her or contacting her.
You have to face facts, the man you married he gone, he is never coming back because he never existed in the first place. The man you married betrayed you, lied to you, cheated on you. You gave him one of the most precious gifts you can give to another human being...... TRUST, and he ripped that up and threw it away, because it meant nothing to him.
You were NOT put on this earth to be treated like that.
I married my childhood sweetheart, he cheated on me, and like you I went through the should I or shouldn't I take him back, He even told me I didn't love him enough to try again WTF!!!!!!
I never took him back, I refuse to be treated like that. I went through the same thoughts as you, would never find anyone like him again (now I hope I don't find anyone like him again), would never have children (I was 30 when we split up), would never find anyone to understand me like he did (cringe worthy now thinking about it).
If you kick him out and tell him never to contact you again, you WILL look back one day and say thank goodness.
Please please please don't let him treat you like that, don't be a doormat, be a strong independent woman.
Take care xx