I use to get this alot and it would really upset me but one day after a particular woman who would pass comment every day was the final straw for me and I just turned around and said "oh it is such a great life, I'm off now to get a cream cake, going to bring it home and put my feet up with coffee and I might even fit in a little nap too , that's the beauty of not living by clock, you can take it easy and not be stressed rushing around". She never commented again.
Another one who always made awful comments about me being lazy and a sponger off my husband, I said to her "I'm so lucky that dh earns so much money that I don't have to work and still have a glamorous lifestyle"....
all these things were untrue, in fact what they didn't really know was I was bringing one child with mild special needs to school and I had spent 20 minutes prising his fingers from the door frame as he hated school, then trying to get him up the road and stop him from trying to run away while also having gotten a severely disabled child ready, fed, medicated, dealt with seizures that morning and would have been heading after the school drop off, to one of our many hospital appointments that took 2 buses and trying to manage a wheelchair etc but people wouldn't see or understand this, they just seen me having a great life with nothing to do.
Funny thing was, many years later one of those women said she used to be envious of me, she said I always looked relaxed, well dressed, make up on, organised and not a care in the world and she hated that she was off to work and would have to finish getting ready in the car.
No one knows what people are going through, many make assumptions, it's always going to be like that. So now still ! , when people make useless comments about my life I just smile and nod in agreement and remind myself that they only pass negative comments because they are unhappy with something in their own life, otherwise If they were content, they wouldn't make those comments and get on with their day.