@Mvslimah I am sorry you had that negative experience at the swimming pool. Out of interest (and I haven't RTFT, so you might have already answered), do you live in an area with primarily white peole? I live in Birmingham and there's lots of Muslims here, so I can't imagine this happening here in my gym.
I'm white, but I am married to an Iranian man and I'm not a convert. We don't follow any religion and my husband doesn't believe in God. So while my husband doesn't identify as religious, many people probably still identify him as a Muslim because of his Middle Eastern appearance.
When our son was very young, we took him on a day trip to a beauty spot. He sat in his pram and my husband put a cloth on his head, sort of like a bandana to protect him against the sun.
There was a woman walking by and she audibly said to her partner "Oh for fuck's sake" while looking at my husband.
We can't be absolutely sure, but we think that this woman thought our son was a girl (back then lots of people thought he was a girl) and that my husband put a religious head cover on our childm
What I am trying to tell is that unfortunately some people think it's okay to openly show their dislike of Muslims. But I think these people are in a minority (I hope)