I reckon the only people who don't receive some sort of comment on the number of children in their family are the ones who have 2!
The most annoying comments I receive are from a friend who has one, and uses it as a badge of honour to tell me how it's great that they can go on expensive exotic holidays, eat out as often as they want, have a really small mortgage because they've never needed to move to a bigger house.....breathe repeat.
I don't have one child, but I'd never make a negative comment to someone who does, nor did I ever use the fact that I had one child to make anyone with more than one feel shit (when I had one, and several of my friends had 2/3+).
This friend regularly says things like "Well, you will have x number of children....!" if I so much as say that I've had a busy day. You've somehow brought it on yourself if you have more than one child, work and are busy, but if you have one child, work and are busy, it's perfectly acceptable to be exhausted.
It's really shitty receiving negative comments about the size of your family, regardless of the size of your family. Some people just thrive on point scoring and one-up-man-ship! I hate it!
for you, OP.