devils I've been lurking but I had to say something about this phone business- there is something very shady about him taking away your phone. He's trying to cut off your space to process this. Why? Doesn't he want you to have help and support? Dodgy, dodgy stuff.
First, he should be bloody grovelling to you, not dictating to you. Jeez, the cheek of the man! Anyone would think he was the injured party here, not you. he doesn't get to tell you what to do, how to deal with this, or what to think. He doesn't get to take things from you. He is in danger of losing his wife's love and trust, he isn't the one who tells her anything. It's okay to be angry with him.
Second, I think he needs to be away from you while you work out what you want. that's your call - it all is- but I think he should really understand that you are deciding, at the moment, what you want- and it might not be a life with a liar. You might decide what you had was worth rebuilding, but right now, you're grieving what is lost. What he destroyed. And I think that you might need space to do that.
Third, do you have friends, your sister, your mum - anyone, ANYONE who can support you face to face, listen to you vent, even take the kids so you can have a bubble bath or go for a run or something? Maybe stay for a couple of days and be a jolly aunt and give you a hand getting through the weekend? You sound very alone; and while you say you're afraid of being alone, you're alone even with him around, by the sounds of it.
Finally, I might be talking out of my arse so do ignore if you'd rather. I'm so sorry this is happening to you.