My dad used to do this all the time and so I grew up not really thinking anything of it, but I do remember being refused entry to restaurants when abroad.
I also found it embarrassing as a teenager when friends would come round and my dad would always have his top off.
I’m now trying to encourage my son to keep his top on. AIBU?