Of course you were having a go. At least have the guts to own your judgemental attitude. The half hearted qualifier about "nothing wrong with that" really doesn't work.
"Frumpy" is meaningless. It's lazy thinking. Said it before on this thread, it's nothing more than trying to make subjective " I don't like" into an objective fact.
There's nothing wrong with disliking a particular style of dressing or individual items. I really dislike jeans. I really dislike trainers. To my eyes trainers just look ugly and I'd never wear them.
There's a big difference between that and saying anyone who does wear jeans and trainers is "frumpy".
I love clothes. I love looking at what people are wearing. I do it all the time. And people divide into 2 camps - those wearing clothes which I like, which I often will compliment them on, and those I don't. The ones I don't just pass me by; it's none of my business.
I can't begin to imagine paying so much attention to an ordinary person, going about their every day business wearing ordinary, everyday clothes but which I don't happen to like, to write a detailed description about them.