Being peri, my body temperature can go haywire at times, though I've never had the proper sweats, iyswim. I live close to the town centre and walk everywhere in town.
It's around 4°C outside at the moment, not very cold, but nippy. I have a "duvet" coat which has hardly been used this winter yet because, no need. I have a raincoat with a fleece lining which I find the most comfortable in the current weather.
Walking everywhere means I warm up quickly and actually feel hot when I go into shops and public buildings. I have hardly worn my hat and scarf this winter at all. I do have waterproof shoes (hiking shoes) which I find more comfortable than trainers.
Quite often unless I'm going for a "big walk" around my local park I don't take a brolly if it rains. (The problem with brollies is that they are crap in windy weather and then when you don't need them you have to have a bag to carry them around in. Very annoying)
My parents live more rurally than me and they also hate going out in too much clothing. It's restrictive and in my mother's case, terrible for her mobility. She wears thermals then a thinner coat on top because it's more comfortable for her.
My daughter lives in London and often goes out without a coat. Hoodie, trainers, jeans, travelcard and phone, done. But she only needs to nip to the nearest bus stop or tube station then in and out if buildings without being outside much at all. DD does walk too, but even then it's a light raincoat, she doesn't feel the need for anything else.