Its not you, its him. He does not have to hit you to hurt you and would probably be physical if he thought that his current tactics were no longer effective against you.
He remains volatile regardless. He targeted you I daresay because he sensed that you were and indeed are non confrontational and do not like making people angry. I am wondering if this all that started in childhood with you, it may well have done. Please give that some thought.
What did you learn about relationships when you were growing up?. This is a question you should ask yourself too.
How can you be helped into leaving your abuser?. I would also think he is all sweetness and light to all those in the outside world and or cannot do enough for them. Image is all important to abusers.
If someone else was writing your post, what would your counsel to them be?
What you are seeing from him is the nice/nasty cycle of abuse and that is a continuous one. You do not mention anything about him "apologising" (the quote marks are deliberate because he is not sorry at all) to you for his actions. This is all on him, absolutely all on him.
Such men too hate women, all of them starting in particular with their own mother.
If you do not trust him there is really no relationship. I would seriously consider your future within this going forward because there really is not one.
Couples counselling is a complete NON STARTER here and such is never recommended where there is abuse of any type within the relationship. You need to talk in both a calm and safe environment and he will not let you do that if you are in the same room as he. You are also not emotionally safe enough to do joint counselling with him either. If counselling is to be considered go on your own, go to Boots and go into their consulting rooms. They have helplines and information re domestic violence that can help you directly.
You do not mention children here but if you are parents the effects of all this within their home is damaging to them too.