Full time/part time. Makes no difference. He is treating you like this because you are a mother.
Falls under sex discrimination. I'd point this out to him and then confirm the conversation by email.
As in, "I was upset when you suggested that my childcare commitments mean I am lazy. Do you understand how that makes me feel and that it is very unfair?"
Then follow up with less emotive email summarising your and his main points.