Tinsel It's two different meanings of skirt, isn't it?
There's the neutral, single-fabric-leg-tube meaning, under which kilts and sarongs and so on are skirts.
And there's the local culture-specific sex-signifier meaning, under which skirt=woman=sex.
You can see that second meaning when the Scots are denying that kilts are skirts, because they're not invested with the woman/sex connotation.
And you and I know all too well that, in our culture, a man who has absorbed the second meaning and wears something that very much fits within that category is telling you something about himself - that there is some aspect of that second meaning which he desires to have applied to himself.