I agree that some blokes do get started on when minding their own business. But most fights going on between males are due to aggressive escalation.
But we're talking about assaults, not fights.
I think a lot of women don't understand the reality that men face. It's easy to talk about 'toxic masculinity', but recognising it as a concept doesn't release men from it's grasp. For example, our society still views male dominance as a desirable trait - some will disagree but it's literally as entrenched as misogyny.
Look on dating sites. Most women want a guy taller than them, and many want somebody to 'sweep me off my feet', or the old classic 'a knight in shining armour (not a prat in tinfoil)'. One of women's most common sexual fantasies in studies is 'being dominated'.
And then there's the media. Stoic, physically powerful, mentally strong, masculine men. Tom Hardy, Jason Statham, Vin Diesel, The Rock, James Bond, etc etc. And before them, the Arnold Schwarzenegger's and Sylvester Stallone's. A weedy accountant never saved the day, and if he did it was probably a satire.
Men often get beaten up whilst trying to 'save face' - a difficult predicament as they'll also become a target if they don't try and stand up for themselves. A typical example might be the teen who talks back to the bully to save face in front of his peers, but then gets beaten up outside the school gates (sometimes even stabbed) as the bully also can't lose face. The victim just wanted to be left alone but couldn't 'back down' or it would just continue with him now being an 'easy target'.
Similar situation when a man walks down the street with his girlfriend and somebody shouts 'don't fancy yours, mate' or 'show us your tits, love'. It's often a group of lads looking for a reaction, and they'll often get it as the man doesn't want to look weak in front of his girlfriend. All he has to do is say 'piss off' or look at them the wrong way and his head is getting used as a football.
My friend is a doorman and tells me that a lot of trouble starts with the girlfriend saying 'what are you going to do about it....you're not going to let him say that, are you?'
I'm as firm a believer in women's rights as any, but it seems that many women are woefully blind to the environment that men live in, which is a constant power play of dominance.