I spent the first lockdown last year working from home in pj bottoms / leggings / yoga pants and i realised it really made me feel very low and bad about myself. I also gained weight that time too (elasticated waists were not my friend!)
I've worked hard to lost 1 & 1/2 stones since then and I now am still working from home and I get showered every morning, put on my make-up , perfume and jewellery and I get dressed in jeans or casual trousers and a top. I feel 100 times better and I've also done a HUGE clear out of my wardrobe and got rid of all the old stuff I was hanging onto for years. It was all good quality so I sold lots of it and invested the money I made in everyday, really nice things mostly from whistles or Seazane. My aim is to build up the everyday lovely things that make me feel good to wear.
It dawned on me that I'm naturally drawn to buying gorgeous 'going out' clothes or tailored work stuff but I had very little for weekends etc so I'm focusing on that.
As I loose the weight the jeans etc are more comfortable to wear too.
So I stay dressed like this until after dinner and I want to sit down and watch tv so perhaps 8.30 / 9pm. Then I get changed into pj bottoms and a vest and a sweatshirt and fluffy socks.
My dh does pretty much the same - casual, smart clothes by day - jeans / chinos with polo shirt / tshirt and wool jumper working from home and he changes into pj bottoms after dinner too.
We're both very happy doing this and have been together 23 years! We love to snuggle up together on the bed or sofa to watch a series or a movie. And soft clothes are far more conducive to this than a suit / tailored trousers.
A lot of my work in the office clothes are semi formal - tailored trousers from Paul Smith, Whistles, Jigsaw with silk shirts and jackets and there is no way I would like to lounge around in them, or cook or clean in them. A lot of them are dry clean only and I really look after them. They'd get really slumpy very quickly if I wore them all day every day!
Dh and I also love to dress nicely to go out together when we can.
I think the OP's husband is wrong to control her though and I would not like that one bit.