This is going to sound odd perhaps, but I've always had a fear of not having clothes, or not being able to afford clothes specifically.
As a child my parents rarely bought me new clothes, I would have to beg for months or rely on getting Christmas/ birthday money. And I would save that so it was there for when I really really needed something. I remember as a child I had 3 pairs of underwear.
As an adult, my main worry about having no money would be not being able to afford clothes. The bills and food would come first, so if no money after that, no clothes. I also avoid spending money on clothes unless really needed, but even then, when I buy something I feel guilty unless a big emergency happens and I can't afford it because I've spent the money on clothes 
I'm sure this fear comes from childhood but it's so ingrained in my mentality and makes me sound a bit crazy.