I notice it more and more as I get older and I certainly used to wear ridiculous clothes myself when I was younger, but I don't think the same applies to menswear.
I look around on the street, on the train etc. And notice that a majority of women's body shapes do not suit the way women's clothing is designed to be tight and body hugging, stretchy, bright, cut out, cut up, decorative and ornamented. Heels, make up and dyed and teased hair add to an overall slightly comic effect. The women have to fit the clothes not the other way round. A minority of women look goodish in this get up and a minority wear t shirt and trousers and flats, as the men do.
Menswear in comparison is mostly practical shirts, trousers, jumpers, flat shoes. I started buying jumpers and socks and occasionally shirts from the menswear section a while ago. They are so much nicer.