I wouldn't say so. The OP has a point, in my experience. It depends on both the area and the doctor.
When I was working, I'd normally attend an appointment in work suits. Now I'm retired and - following some years as a carer and now a widow - I have reached the "can't be arsed" stage and have started attending appointments in my jeans.
It makes no difference with my GP and with reasonably youthful hospital doctors, but an older consultant treated me like an idiot when I saw him.
He told me the name of my condition and then: "Oh, you won't know what that means!" (because it was in Latin). You had to be there: I promise he was being patronising, not explaining. I drily commented that my degree wasn't in medicine, but that I had done some Latin at school.
He then asked what my job was. I explained that I was a teacher, but only do a bit of supply these days and he stopped treating me as if I were daft. (I can't say that he was much help, however. I was advised to avoid stairs and walking on slopes...In Scotland?)
I live in a predominantly working class area. I recall when I was a student seeing a GP because the Blood Transfusion Service had refused a donation from me: the on-the-spot test that they had administered had shown that I was anaemic. (I'm not surprised - 20 yrs later, I was finally diagnosed with endo.) They insisted that I make an appointment to see my GP.
I duly did as I had been told. A blood sample was sent off for testing. On the return visit, the GP dismissed me with "Well, you're anaemic for a man, but you're not anaemic for a woman from this area!"
The next time I saw him, I wore my uni scarf. His attitude was very different.