YANBU. Maybe you have an underlying medical condition that should be checked out? Poor circulation, thyroid problems?
And are you sure you are wearing enough clothing for you - i.e. not the clothing industry's idea of "warm" clothing?
I live in an icebox old stonebuilt house, and I have found when working at home on the PC and not moving about I got very cold.
Have a think about layers and fabrics - I wear longsleeved thermal vests and "long johns" in the winter [niiiiice!], I don't bother with acrylic jumpers, they're not warm enough. I wear a lot of wool. Also I don't wear much cotton in winter - prefer thermals, Uniqlo heat tech etc.
Typically I'll have a thermal base layer, a woollen jumper, and a woollen cardi over that. Tights, longjohns, trousers and socks. My slippers are calf-length sheepskin booties. My boots are thermal-lined. I have sheepskin insoles in my wellies. My coat is windproof. And I wear a scarf indoors and out - doesn't have to be a woolly one, anything round the neck goes a long way. Hat and gloves are really a must also. I sometimes wear a beanie hat in the house (but usually because I've been wearing it in the garden and can't face taking it off to reveal my "hat hair"! I don't look too Michelin-esque. 
As an experiment, why don't you try upping the number of layers/ amount of warm clothing you wear, and see at what point you start to feel more comfortable?
The other thing that keeps me warm is doing the hoovering ...
Good luck OP it's horrible feeling cold.