Generally speaking from my perspective men don't wear "fashion" to work.
They just wear business suits. Cheap to expensive they are quite ubiquitous and therefore serve as a neutral enough background for what they are doing and saying to be at the front, not their bodies and how they are draped.
Women don't follow this business convention, they wear all sorts of stuff which this thread has called fashion.
Definition
a popular or the latest style of clothing, hair, decoration, or behaviour.
So women and men are doing two different things, fashion being about "popular" clothing, and therefore likely to be discussed.
Men's suits are not "fashion" in the same way and unlikely to be discussed as a result.
It's two different behaviours not double standards.