When I first started meeting rich people, their outstanding characteristic to me was how CLEAN they looked. Someone else pointed out that they never have to get the Tube or a bus, or battle through busy streets in the rain, and rarely pass 10-12 hours a day without access to a shower and a change of clothes.
This was in the city; I imagine the horse/dog country wealthy get dirty fingernails, muddy boots and rain-fuzzed hair, but the underlying cleanliness is probably still there.
They used to have their newspapers ironed so the print wouldn't transfer onto them (King Charles still does). Wealthy 'polished' women have their hair done every day. Their clothes are never wash & wear; they're either dry cleaned or professionally laundered; always pressed. Loose threads, buttons and scuffs are immediately fixed. And, as others have said, clothes are made to measure or altered for the wearer.
If you're really bloody determined, you can replicate this without spending a fortune although it will take up extra time. But you'll still accrue a light veneer of daily grime so, once you've been up and fully 'polished' for more than a couple of hours, the rich will be cleaner than you.
Layering shades of beige in silk & cashmere isn't enough - in many cases, it simply makes you seem over-anxious about your wardrobe. Looks good on a very clean, lightly-tanned blonde, though [shrug].