No difference between my vest tops or PJ bottoms for sleep and any other vest top. I'm too fat for leggings, but plenty of people go out and about in those.
See also flip flops v hard soled slippers.
PJs round a supermarket or at a school gate, yes I agree there's a time and a place. Dragging the dog out for a pee, I couldn't care less.