What so you mean it'll sort itself out?
Do you mean, you'll bury the fact that he's said these horrible things under the carpet and remain with him, always knowing he said these things to you?
I'm sorry op but it's time to realise your worth!
He doesn't get to be so cruel and then just, stay.
Its utterly disgusting of him!
It's abuse, quite frankly.
Either, as pp said, he is having an affair and is hoping you will leave because he's too much of a coward to be honest and doesn't want other people to say he's the bad guy.
Or he has said these things solely in order to hurt you. Which makes him a total nut job.
Find YOUR self love and respect.
Tell him to bugger off and that your lawyer will be in touch regarding the divorce.
Don't be patient. You don't owe a cruel bully patience. There's no way you can sort things out with someone so disgusting. And he won't get the gears in motion to leave it seems so you're going to have to find your voice and start taking steps to either get him out or go yourself.
Or you'll be sat there a year from now waiting on him to make a decision. He's already made it. You need to be proactive. Don't leave the ball in his court waiting about.
He's not nice. Life's too short!
You're worth more than this. It's not a woman's job to forgive the bullshit and carry on living with bad men. You'd die inside.