Yes it was a hurtful thing to say, but sometimes it's necessary to look at what we do/buy/wear and spend our bugget more wisely.
It's very easy to buy another pair of Joggers, black top, cheap trainers, when the current ones get shabby. Sometimes we do need to step back and think.
My DSIS is a big apple. She always looks nice. Her general outfit is a pair of straight legged black trousers and longish patterned (usually, Evans top) not tunic length and certainly not a dress (she'd look like a bell tent).
Dark cardigan if necessary. Black ankle boots in winter/black hotter or other comfy sandals in summer. She works in an office where she can chase up and down the stairs when need.
Outside she tends to a black/dark coat and a whole array of scarves (handy for presents)
At home she swaps the work trousers for straight legged jersey ones. Same style top, she's collected so many they just get down graded from office to home.
Honestly OP you need to find some trousers, be it trousers, jeans, good leggings or whatever that fit are comfortable and look good and then try on every sort of top. I can't tell you what will work.
Cross over tops look amazing on my big breasted DF, they don't work on DSIS or me who have more tummy or hips than boobs. Neck lines DSIS can wear with her broad shoulders I can't.
You may find tunics or dresses work. I wear them, but I look very dumpy and Mumsy. Too much arse, too narrow shoulders, too little boob and too short. I'm happiest in skinny jeans, long boots and a long sleeved Tshirt. I'm a big a bummed, wide hipped vanity size 16, so I look like a carrot. However, much experimenting has concluded that a carrot is better than a squarish blob.
Good luck, start by trying on a lot and buying a little.