Old thread but still valid.
They hide in cracks so not the cleaners fault. They also fly in from outside. The larvae (woolly bears) can cause skin irritations but are harmless.
Wash or freeze clothes, same as for clothes moths, pack them in sealable plastic bags. I also keep mine in plastic boxes (but I don't currently have a wardrobe). Shampoo carpets, then spray with Indore or Acclaim flea spray, the active ingredient kills them, do not stay in the room and wear a mask, the stuff is nasty, air the rooms, best to do one room at a time.
If you don't mind dust and prefer a natural approach then diatomaceous earth, food grade, spread on floors, left for a few days and swept up will kill them.
I have moved into a house where the previous occupants were lazy about cleaning and didn't bother to treat the problem, the above will get rid of them but they can easily fly in and start all over again. I keep all my bedding in bags too, everything that is not in regular use is bagged up.
They do eat fabric, it looks like moth holes.