I clearly remember going for interviews for my second job out of uni, and noting that when I was shown around a lab, all the men (all men) were wearing geeky t-shirts.
It wasn't that I didn't think I would fit in though (I loved all that stuff just as much as the next geek). It was that I knew that the kind of young men who wore those t-shirts tended to also be the kind of young men who mis-interpreted any amount of attention (eg. casual work chats) as romantic interest, and the thought of moving country and trying to walk that line of making friends without getting groped in the lab didn't appeal (among other things - but it was one little cross on my mental pros and cons list)
In contrast, the job I actually took, I went for a weekend to the (different) country, and they actually took me out for the evening after the interviews (all men again, but a fair smattering of girlfriends joined us) - everyone was professional sociable, without being creepy, and that sold the job to me as much as the job itself.