Absolutely not. Not mine, nor DDs (not now or when she was a baby). Both alive, healthy and kicking, no allergies, skin conditions, whatever.
I really can't be bothered agonizing about the amount of people who potentially sneezed on my clothes, tried them on (so what?), how many dogs were near it, how many kids. Honestly don't care. If it's new and looks crisp and new - it's going to get worn.
As for the evil 'chemicals'. Everything is 'chemicals'. Starting with the laundry detergent and softener. Cosmetics, perfume, skincare, shampoo, etc, hair dye, nail polish, chemicals in food and drinks, household cleaning chemicals, dishwashing chemicals, etc etc etc. So can't be bothered about the mysterious 'chemicals' on clothing.