Omg that's just unlocked a memory! When I first worked in city law I worked at a US law firm's London office. We (the trainees) were all flown out to the head office in New York for a sort of induction with all the US first years. Smart casual dress generally - suits required for some meetings. This is late 90s. One of the speakers was a guy who used to be managing partner and had since retired. He must have been 80 odd and so his heyday would have been 1950s I suppose.
Anyway he said that "y'all look like you're ready to work in your gardens" about our smart casual wear. He also had a great anecdote about a grumpy old partner of his day asking him sarcastically if he perhaps needed a loan to buy a suitable hat.