Working at home with children is a hell of a lot harder than escaping out to work among adults.
Everyone says they are at work 'for a rest'.
Obviously we all know work isn't a rest, but people commonly joke about that because they are acknowledging their preference to the drudgery and boredom that comes with running a house and child minding (even if it's your own!).
When I'm caring for the kids, it's refreshing for everyone to have someone else walk into the room, and it's nice for their Dad to come home 'fresh' to the kids, even though he's not fresh from a busy day at work, iyswim.
It boiled down to that age old argument of who is the most tired and who works the hardest. Well, LIFE is hard work eventually, and no one can escape.
I have seen visitors so many times in hospital, looking longingly at the patient 'resting' in bed all day long - well I can tell you that even someone lying in bed all day long isn't necessarily having an easy life I can promise you!
So - I am sure your husband works hard, but I am sure you work equally hard, just in a different way. It's a shame we can't all walk in each other's shoes to gain a bit of insight, rather than each fight to say their corner is 'harder'.
I would find your scenario annoying too, but that's only because I've been on both sides of the fence and to be honest I found being full time ironically easier!