Your baby is 4 weeks old?! Are you getting any sleep??? OP YANBU at all.
I have 2 DC's almost 1 and almost 3 and am on mat leave. Although the youngest is not tiny any more he doesn't nap (unless we are out) and is still very clingy. My toddler is bonkers and can't be left for too long or he gets himself in some kind of trouble. He doesn't nap either. Although I can now leave them for a little bit of time, I really struggle to get any "serious" housework done when I'm on my own with them.
I've tided the toys away at least three times this afternoon. They are still everywhere as they got pulled out just before dinner and I can't be arsed now to put them back again!
When DH gets home from work, he either cooks, or takes over with the DC's whilst I cook. We have a cleaner who does all the main stuff, I clean the kitchen after each meal, and sort out the washing in the evening. I don't iron, DH irons his own stuff as he needs it.
And as for going out for 8 hours every saturday, wtaf? Once you have a child, you just can't do that sort of thing anymore, not at this early stage anyway.
My DH works, so do I, it's just that my job at the moment is looking after our children. How people think that their DH's "deserve" their dinner on the table when they get home I just don't know! Like people have said, it's not the 1950's!