I don’t mind the fact that they might think I’m weird or unsociable, just don’t call me out on it! I’m there to work and learn, not to fulfil my social life.
Sometimes the only answer is to leave and get a different job. My first job was with pretty "normal" people, they weren't particularly introverted/quiet, but also not particularly loud/extraverted. There was a group of 3 of us in a pretty tiny office, and we got on well. We could go a full morning without saying more than our hellos, or we could have a quick bit of chit chat if the weather was particular extreme, or there was something unusual in that day's news, etc., but usually we didn't do much random nonsense chat or talk about what we did last night or the weekend etc. As it was my first job, I thought it was pretty normal.
However, my second job was a nightmare. Open plan office with maybe 10 people, and despite it being the same kind of work, the same kind of professional/qualified people, it was constant chit chat all day every day. That wasn't the worst of it though, because it was a larger firm, there were lots of different depts, so they did lots of socialising, i.e. pub nights, they had their own local league football team, club nights, they had a darts team, some went to dance lessons together etc. That's all fine, but they would be constantly inviting me to things which is obviously nice to be included, but they wouldn't take no for an answer, and soon the snide remarks, bullying, etc started. I lasted less than a year and just had to move on as it was soul destroying.
My third job was more like the first, another big firm, doing the same thing again, but they were, again, more what I'd call "normal" middle of the road people, where there'd be a bit of chit chat, but mostly people worked quietly and just did their job, and except for the annual Xmas meal, there was no socialising out of work, so no pressure in the office to conform, go out with them, etc. It was bliss and I stayed there for about 10 years! None of us were particularly quiet/introverted to the extreme, we'd all chat occasionally and got on really well, but ultimately, we all had our own lives outside work and mostly kept our work and home/social lives separate.
Sometimes, it does take a while of changing jobs to "find your tribe"!