Right. This could be a slippery slope (for you).
How did your husband 'recover' from work before you had a baby?
Nice meal, some wine and a shag?
Yeah, wise up buddy, those days are gone for the time being.
Caring for a small baby 24/7 will knacker you out beyond belief.
Work does not equate to this. I can say this, because I work, and have done since my babies were small. Let me tell you that work is A BREAK.
Children are wonderful and gorgeous but the sheer workload involved in taking care of them, entertaining them, trying to keep the house from turning into a total pigsty (sorry pigs, that's not a slur), is absolutely exhausting.
Remember that your husband has ALWAYS had a job since you met, this is something he is used to. And I'm guessing he never moaned before.
YOU BOTH have an added an extra responsibility in your life now. You both need to make changes for this. Your husband can't just carry as normal and leave you with the drudgery the whole time.
Yes, it's really hard work, and you'll need to work harder, but so should he. Fairs fair. He can't just continue his pre-kids life just because he goes to work.
One day a week for you to have an extra hours sleep is entirely reasonable I think.