People are literal mammals, we live under a VERY thin veneer of civilisation, don't kid yourself that you would never resort to violence, the truth is that it wouldn't take very much at all.
Now some dogs are just fucking dangerous, and no amount of training or socialisation can fix it. People aren't too different, we think we are, but some people are also just fucking dangerous, they are the XL Bullies of the world.
Men, as mammals, are more physical, violent and more prone to aggression than we are, not much more, but enough to make it noticeable. And a handful, a tiny percentage of men, are predisposed to extreme violence, and they don't care who they target. We also have a tiny proportion of violent women in prison too, it's not just men.
It's that tiny percentage of extremly violence that the majority of both men and women have to fear. So yeah, I think men are also sick of male violence, but that violence is more inate and animalistic.