Honestly OP? Fuck 'em. If it works for you and your family then who cares what others think?
My son is school age, my husband works full time and we live abroad as my partners work requires it. We move country every 4 years or so. I've been able to work in some of those countries but this country and our last one I am unable to for various visa and language reasons. Would I prefer to work? Yes, I'd love to, it can get boring being a mum at home alone with the kids at school. I'm looking for work, but it is hard to find a job with a UK company that allows you to work from home and in another country, even though I'm still classed legally as a UK resident.
But while I'm not working, be it for the next few months or four years, I'm going to make the most of being able to have so much free time. I've spent my time writing a book, taking creative writing courses, taking language lessons, exploring the city I live in and meeting other mums in similar situations. It's a luxury (that I don't take lightly) to be in a position where we don't have to both work and we have more energy and time for our son. I can clean, tidy, wash clothes, do the ironing, walk the dog, cook dinner and be at every school event, and still I have plenty of time to do things that interest me. If that makes me a housewife, so be it. I don't judge others for the decisions they make, and I spent the first 2 years of child's life working full time, so have seen it from both sides.
So don't take what other people say to heart - if you are happy and it works for you, carry on.