YANBU but he bloody well is!
Sleep deperavation can make you seriously ill,if it goes on long enough it can cause serious depression which then could lead on to something awful happening.
When you have children together they are both parents responsibility equally.If only one person in the family does the majoritie of all child care and running of the household then they are affectively living like a single parent family with the added stresses of looking after another adult.
That's really not on.I've been a single parent in the past and it was a good time for my children and myself but I didn't have an adult man to look after as well.I did when I was married to my first husband(now ex husband)and it was an exhausting and miserable exsistence for the children and myself.
He may be the one bringing in the money but your the one providing the child care,the one I presume that cleans the house,does the laundry,cooks the meals,does the shopping,dr's and dentist visits,you maybe also pay the bills and balance the books,do the shopping and organizing for all birthdays,anniversarys,christmas ect.
If you weren't there to do all that then he'd be paying out a very large percentage of his wages to cover all those jobs.
Everyone is entitled to some time of,we all need it allows us to breath,to relax,to take in life and what is going on around us.It's good for your soul,emotional,physical and mental health.
Just because he goes out to work doesn't mean he's any more important than you and doesn't mean he has any more right to free time and decent nights sleep.Your equals and he should be treating you as such!