1.5hrs is nothing! It flies by when they are asleep. The time is usually used up doing things it's hard to do when they are awake, like phoning the bank or making appointments, sorting mail, internet shopping/banking etc or bleaching the loo.
Ask him if he would really rather you left the child in a play pen, or if you don't have one then to empty the kitchen cupboards/draw on the walls/eat the plants, while you clean the house?
If his answer is no, then tell him to shut the fuck up about your 1.5hrs a day! Once he's shut the fuck up he can agree to give you your half day off every weekend.
If he is still being an arse, work out how many hours a week you both do and present him with that. Tell him that if he doesn't start valueing your job your going to stop valueing him.
Also point out that you find it rather strange that a loving dad who doesn't see their child all week would chose not to spend every minute at the weekends with them. "You do like spending time with your child, don't you????", should do it.
Also out of interest does he get the train to work or drive? I see that as "me" time it itself as you are alone with your own thoughts which as a SAHM to 2 children I never get! Does he have a lunch break?