Isn't it standard to say where you're going, without even thinking about it really? Whether its your DH, DCs etc. "oh Im just popping out to shops/to see so & so, see you later". I can't imagine just getting up and going out not a word said. Imagine putting thought and energy into being sure to NOT say where you're going. Thats just wanting an argument and bad atmosphere for the sake of it.
Ive read a bit here & there about some men who are retired and feel a bit lost/purposeless so they either do this, or get under DWs feet trying to micro-manage chores, etc. Its stupid behaviour..so, the DW is the one to be "punished" because of the way DH feels? Why not think well, we have free time now so lets explore the city, find a hobby we can do together, enjoy some leisure time etc. But no - its all about making DW feel like shit.
Id rather make a life, find some hobbies and build good friendships, than put up with that kind of negative bs for god knows how many more years to come. I bet if he were in the house with his DCs or relatives, he'd mention where he was going and likely time he would be back. Complete lack of manners and there's no excuse for it. I really can't bear people who "deal?!" with their issues by taking it out on others..just like that, an assumed god-given right to make someone else feel bad.
Since you live together OP you may as well just let it go just for now, focus on being the best you that you can, what makes you feel fulfilled, and re-visit the subject at a calmer time..he wants you to get angsty about it anyway, so why even get into it. Life's too short for these petty little games, really.