It might be helpful to go back to the therapist and get them to help you to leave him, so you have some real life, unjudgemental, support in place.
As he brings nothing to the table you will not be facing a financial loss, and I think that once you break through, you will find you life improves so much.
He has somewhere to go - so that shouldnt be any kind of barrier.
Practically, does he have all his clothes clean and ready to go - if he took them home today, would that leave your house free of him.
Could you text him once he has left to say not to come back, that you are finished. If not this week, but perhaps another week thats just like this week.
You sound as if you are ready to pull off the plaster but are scared of the reaction from him when half his support network pulls the rug. Thats not to be surprised because he sounds nasty. Some people call the police to alert them that they are breaking up with someone, just so an alert is ready, even if not needed. Done by text once he has left, you could inform him that the police have been notified and should he decide to come to the house, they will be coming and you wont be opening the door. He likely wont want the hassle.
Its scary to think of change, but your life sounds so worn down by him in so many ways. Think that many women have had partners they love dearly leave them, and they have survived and moved onto a better life, so a man who is awful leaving IS survivable, even if right now it sounds frightening.
And dont forget that he can gaslight and blame you or say you are over reacting as much as he likes - it still doesnt mean you have to stay with him, because it is a free country and you can choose to divorce for any reason that you want, you dont need his consent - thats only relevent at the marriage part.
The marriage contract holds so many promises he has broken. Ultimately though, you dont want to be married to him any more, and that is the only thing that matters - no fault divorce means you dont even need to explain why. It can be done quickly and easily, and even if he objects, it will still happen. You have the power to do it, and I believe you can, and will.