*exwife
Feminists want to abolish gender stereotypes. They don't want girly things to relate to women and macho things to relate to men. It's harmful for both men and women!
Look at my posts on the feminist board. How I have said how brilliant it was in the 80s when guys in full make up and wearing a sarong would be walking along next to women in torn jeans and a safety pin through her nose. We had a brief honeymoon period in the 80s when gender presentation was being blurred between the sexes. Not exclusive to them.
Women can easily wear men's clothes. Because it's punching up (the hierarchy). But men wearing women's clothes is viewed as wrong. Weak, cissy, gay as a slur.
If women were considered as equal to men, no one would view women's clothing as punching down.
Eddie Izzard said it brilliantly. When he was asked why he liked wearing women's clothes, he said they're not women's clothes they're my clothes. In our strictly gendered society, he managed to pull off an almost impossible feat. Wearing women's clothing, but making them neutral.
At the moment, if men wear women's clothing, there is an underlying motivation to it. It's not just a preference because they're comfortable, the colours are good. It's because they're 'feminine'. (This is probably where you're getting your viewpoint from. Wearing clothes purely because they are designed for women, is saying that women's clothes must be a certain way - which is anti feminist).
If masculine and feminine were less rigourously enforced, this wouldn't happen. Clothing, and the rules around them, are only a symptom of how society reinforces gender. But it's a fairly visual one as everyone has to wear clothes.