I'm lucky in that my office permits casual wear for day to day work, such as jeans, trainers, etc. However, when I have to go to meetings with customers I have to dress up and I HATE it.
For one, I don't have the figure for it. Day to day I wear casual dresses, jeans, jumpers, trainers, boots etc. Formal trousers look terrible on me, as do suit skirts. I have a large chest and blazers look terrible too. I also HATE high heels, they give me blisters and are very uncomfortable.
Second, formal wear is usually itchy and uncomfortable. And cold. and did I mention the shoes? Even flat shoes, such as dolly shoes, are just not suitable for the winter months.