A few questions...
How explosive is his temper, are you the only one on the receiving end of it?
Considering his explosive temper, do you have any concerns about his parenting?
Why would you want to stay married to someone who thinks so little of you?
On the face of it, he is the SAHP and to ensure continuity for the kids it would make sense for you to move out, men are expected to. However, I am getting a distinct power imbalance vibe and added to that, the guilt of being a working mother, may lead you down a path that could profoundly change the relationship you have with your children.
I think you need to think long and hard about what type of parent you want to be and what level of involvement you want in your childrens lives? It sounds like you initially thought, it would stay be the same but with you living elsewhere but the dynamics of being a RP and a NRP are very different. Your children's home would also be their father's home, this territorial change will fundamentally change things, daily visits may not be in the best interests of your children if there is an atmosphere.
You should also definitely see a counsellor on your own, to work out what you want away from someone trying to guilt trip you. The first time I went into mediation with my Ex, my accommodating nature was used against me and I was passive aggressively backed into a corner (I even agreed to waive child maintenance), the single worst experience of my life. Four years later, I am into the second round of mediation and my Ex is behaving exactly the same way but this time I've had counselling. I am a better advocate for my child because I can better separate my and his wants from her needs and have written a Parenting Agreement that demonstrates this, which has made it very difficult (he still tries, bless him) for my Ex to paint me as uncooperative and selfish.
Mediation is tough and you need to be in the best emotional shape to get through it, preperation with a good counsellor is a must.