Where do you work? I'm a consultant formerly a partner, in an upmarket, private client, non legal aid law firm. I personally wouldn't wear those dresses as they're not really my thing, but with flats and a cardigan, no one would, to use a favourite MN cliché, bat a eye lid.
What you're describing sounds terribly dated.