100% YANBU.
My DH does nights some weeks - 10.00pm to 7.00am, and he gets in at around 7.30am to 7.45am. He usually goes to bed 30 minutes after getting in. (We sleep in separate bedrooms and have done for the past 15 years since our early 40s because of his snoring.) So most times I wait for him to go to bed, and get up about 10 to 15 minutes after.
Unless I have to be up early, I wait til he has gone to bed before getting up, because when he gets in from work, he's really wired, and hyper, and won't stop talking, and following me from room to room, telling me all about his night at work.. If I've only just got up and not even had my shower and my first coffee, I can't be arsed to listen to him going on about his night at work, and buzzing around me like a wasp.
I would much rather just sit and have my coffee and breakfast alone, with the TV, or mooching through Mumsnet. I work part time, mostly from home, and my hours are flexible, so I have the luxury - fortunately - of being able to lie in til 8.30am if I wish. By then, he's gone to bed!
If he is at home, that's fine, because I usually get up before him, or around the same time. So he is just as dopey as me, until he's woken up properly! I just can't be doing with him when he's got in from work, especially as with you @PartyQuestion30th he will spend 20 minutes regaling me with what's been happening at work, only to tell it all to me again, 8 hours later - about half an hour after he gets up in the late afternoon.
.