Springfleurs, I think Janos's suggestion is good.
He's clearly getting a power trip from making you change your tone, and you don't want to give him the satisfaction.
My suggestion next time he pulls that stunt is-
a) Tell yourself- "He's power tripping, I'm being reasonable."
b) Tell him- "It's clear to me that you can't discuss this in person without having a manipulative tantrum. We'll finish this discussion over email/text."
or even more succinctly, if you feel yourself getting really emotionally wound up by him
"We can finish this discussion over email/text."
c) WALK AWAY. He'll hate that.
He'll call you names and try to get you to engage as you walk away, because you just stole back his power over you. It's like with toddlers. They have to have the tantrum until they understand the boundary has been drawn. Try not to let him see you grin from ear to ear whilst you metaphorically put him in time out.
It's OK to feel angry, btw. You've all put up with more than enough shit to feel as righteously angry as you choose. Obviously violence is not OK, but feeling really angry when someone has mistreated you as badly as these men have is actually a healthy response. It's a healing stage. Don't let anyone tell you otherwise.