YANBU to want him to step up generally, but maybe a little bit U to stay out past midnight if you know it is very likely to cause him a really broken night.
It sounds harsh, but if you are the one on maternity leave, you are likely the one that is able to catch up on some sleep at other times (although I admit I was totally crap at this). Your “job” currently is looking after your baby, hwhich is very tough but gets easier. So he should be able to take an evening, but if he wouldn’t manage at work the next day if he had to do lots of night wakings, then can you be back by midnight?
On the other hand, there’s no excuse for him not stepping up more generally. Do you get any time to yourself? Unless there’s a specific reason why he can’t do some time with your DD each day, he really really should otherwise she won’t bond with him and he’ll struggle with her when she’s older. My DH had very little time with our DD (training on the job as a teacher in a school that was a long way away, so he would get home late, leave early and be exhausted most of the time), and that has been a very tough cycle for him to break. She’s now 3, and although he does have time with her, if we’re both home she shows a very strong preference for me which I think is saddening to him. He also finds it difficult to provide basic care for her because she is non-cooperative towards him - she’ll let my mum help her clean her teeth/do her hair etc with no fuss, but apparently she makes it very difficult for DH.
This won’t change unless you make it change. I wouldn’t start by pushing it on work nights as I imagine he’ll respond badly, but at weekends you need to make sure he steps up. Arrange some short coffeee dates etc with friends to make sure he gets regular, but initially short time with DD (I feel like it’s unfair on her otherwise, because she’s little to be with someone she doesn’t really know that might not be confident with handling her - they pick up on this). Insist that he does alternate nappies at the weekend.
Do you also do the majority of other work around the home? While you could argue it makes sense for you to do more of it during the week (depends a lot on your circumstances and you baby), does he cook meals at the weekend? Or is this a generally lazy bugger situation?