@Bloobloo YANBU.
I do love my DH, and enjoy his company most of the time, but when he is at home when he shouldn't be - he drives me loco..
By 'when he shouldn't be' I mean....
...., when he was off for 6 MONTHS during covid (on furlough.)
...., when he is off sick for several weeks - after a hospital procedure etc...
....., when he is on nights (he does nights one week/days the next,) and he gets up at midday! (Instead of the usual/expected time of 4pm-ish.)
It really upsets my routine.
I don't mind if he has booked time off, because I am prepared for it, and we usually plan stuff. And Christmas - and Easter - they are fine too. He has around 10 days off, for Christmas and for Easter, and the family time/couple time is nice. But when he is suddenly off (and off for a while,) I hate it. I can't stand him hanging around the house all day!
I can't articulate why. I know some people will say 'it's his home too. Why should he not be allowed to be in his OWN home?' It's hard to explain. It's like a man's presence is so LOUD and in your face sometimes, and his presence just dominates! Even when the kids were little, if he came home from work in a bad mood, or got up in a bad mood, or was just in a bad mood for the weekend, it would affect the mood of the entire household.* *
He rarely has bad moods these days - now nearly 60 - BUT he dominates the TV, he doesn't stop talking, and he puts on what HE wants on the TV but then chats through it. 
I have to wait for him to not be there before I can watch what I want to watch properly. We have a lot of stuff that we watch together, but with MY programmes - I have to watch alone, because he just chats through them!
He follows me around like a puppy when I am trying to do things/chores etc, and when I stand hand-on-hip and look like 
and say 'what do you want?' he says 'I have just come to chat.' CHAT?! I am busy - go away! We have time to chat when we're having dinner/later this evening when we're relaxing in front of the TV.
No matter what I am doing - working, or doing chores, or trying to relax and read etc, he just KEEPS TALKING. And he keeps asking things... have you seen this, have you seen that, do you know this, do you know that - yabber yabber yabber.... Some days, he can't go 30 seconds without talking.
This is much more when he has a spell off work and is running out of people to talk to by the way!
When he is at work, he's not so bad, and does want to relax himself, and keep quiet for a bit. And I enjoy seeing him, and we have things to chat about.... But when he is off all the time - he gets bored and he does fuck-all, so has nothing to chat about, so he just follows me about trying to 'chat.' I work from home too - 18 hours a week - and that is impossible with him gabbling. I have to lock myself in the bedroom to work!
But yeah tl;dr, I prefer DH when he is working. Can't stand him being off long-term, because he can't occupy himself and has no hobbies (that take him away from the house,) and he has no friends - well he has several friends at work, but when he's not there he doesn't see them.
Fuck knows how I will cope when he retires! He rarely leaves the house, and never without me! (Only for work! And that is only 24 hours a week.)
And before anyone says 'why don't you get out of the house more?' I DO. I go out several times a week with a friend, or one of my DDs, and I have 2 hobby groups outside the house. Also, 4-5 times a week I go for a 3 mile walk. He never comes. He CBA to leave the warm house!