This is a very common scenario.
Your confidence has been shot, must feel very unsafe and obviously feel shell shocked in how cruel your h is being. There is no question that he is not being abusive, he is.
His purpose at the moment is to shame you so you are silenced, shamed into accepting the status quo, he is riding high with his ego and has lost touch with any sense of right or wrong, his moral compass is fucked.
You are waiting to see if that sense or compassion returns, how will you feel if it does, are you hoping that if he see the light you will then punish him ? because at the moment it appears any punishment would not even bother him, he is occupied with another and his ego.
I understand you feel weak, he does too, he knows exactly what he is doing and it is exeptionally cruel, you must feel battered, exhausted and must believe he is trying to destroy you. He may not even understand how this behaviour will change you fundamentally and your relationship, he maybe deluded in the fact that he may believe your love will never end for him.
We know how this feels, bouncing from anger to depression, unable to make a move for fear of exploding the family and your entire way of life, and it's this he is banking on. Your reticence in blowing everything up.
I would suggest taking things step by step, understand your depression is sadness energy turned in on yourself, the anger is outward energy, pick your times to act. He's making you ill, so self care and understand anger burns itself out so ride out the sad bits and protect yourself more.
You know you need to act in some way, for starters, no sleeping together, no cooking, cleaning of his stuff, no helping his life, get out and leave the children with him, prepare him with a taster of having shared childcare. I would stop contact with his family, if they ask tell them the ow can visit them, he takes the children to see grandparents himself. This is what separate lives look like and this is what he is pushing you into.
You ask your family not to speak with him, he is a liar and is trying to get them on side and allienate you.
Grey rock him, he is no longer your friend, treat him as a stranger, just as he is treating you, you must enforce some boundaries, even though you feel so weak.
I also do think reading up on narcissists is quite valuable in these situations.
Go to the Gp (preferably female) many understand this is one of life's most traumatic events and will log this down as potentially abusive, get percriptions if tolerable or needed. Make a solicitors appointment, an initial appointment and find solo councilling for you.
Take council with those that support you, disregard the rest and do not feel bad about that, now is the time to be selfish, put your needs and wants above others, if they do not understand that is their problem, you need your strength.
You have a battle on your hands an awful fucking time, wouldn't wish it on anyone, don't let anyone negate that pain or minimise it on your behalf.
Keep posting, you will find astonishing advice on her at every turn if needs be.
Take care.
And remember there is no shame in being a kind, honest and moral person, he chose to react like this to your pain, take no shame or blame.
If he tries to cut you down or if others do, come here we will build you up.
x