Look, some people breeze through early parenthood in a haze of cuddles, milk and talcum powder. I've yet to meet one of them though.
I had a relatively easy pregnancy and an easy birth from which I recovered quickly, physically.
At four weeks tho, I was really starting to lose my shit. I was sinking into PND which involved horrendous anxiety just thinking about DD waking up, she was crying constantly for 4-5 hours every evening, from colic and we now realise acid reflux, she was difficult to feed, due to reflux, I was either sobbing or generally silent and tight-lipped and extremely tightly wound about everything. DD meant broken nights as of course young babies do, but even in between that, I couldn't settle to sleep as I was so stressed out.
I had a v supportive DH, lots of other family and friends nearby (like literally within 5 minutes if I really needed them), and I still barely coped.
It was at about this time that DH finally admitted to each other that we both just felt black inside.
I know my experience was particularly bad, you will probably not have this experience, I sincerely hope you don't, and wish you much happiness & joy along with the requisite talcum powder & cuddles, but really, your DH is being a twat if he is even considering this. Neither of you have any idea what your situ will be at that point - early/late delivery, VB/ELCS/EMC, long/short hospital stay, BF successful & easy or the opposite.
Put simply, if there was ever a time when you need each other, this is it.
Sorry if my post sounds overly negative & dramatic (and possibly patronising, which I absolutely don't mean to be), I don't want to make you worry about things that may not happen to you, but DH needs to be aware that the first few weeks with a new baby are hard, very hard, and he has absolutely no idea how much he is letting you down by even suggesting this.
D