Jeans are a law unto themselves. I've had to buy different sizes to get the same fit in the same style, in the same shop, on the same day.
Your size in tops not changing much is logical, the bust is the greatest decider on fit for tops and that's not gone down much. Well, assuming there is some sort of structure to the top.
Cardies have about the most flexible fit of any item. Obviously.
Tshirts are damned flexible too, always going to work a few sizes up or down.
Pants, likewise, need to be grossly mis-sized to fit dreadfully.
I wonder if a lot of the stuff you were wearing was at the top end of the range of fit (IYSWIM) when you started losing weight, and if the stuff you've bought now is at the bottom end of it's range of fit. It' make sense with having got used to wearing loser stuff as your size dropped.
Shoes, tailored stuff, non-stretch skirts, belts, they tell the truth. There is very little flexibility in the fit at all. Fact is, a 38 inch waist wont fit into a (stiff) 32 in waistband but a 32 inch waist will. That's a difference of several sizes, which ever way you slice it.