So you're a man who breaks the law by using women's single-sex spaces. And you then ask, why is there dislike of transpeople?
The answer is fairly obvious, don't you think?
But if you want it spelt out, and you ask:
How does a trans person using a single sex person puts anyone in danger?
Let's work it through. You think you "pass" but there has been around 10 years of transactivist rhetoric telling us that it doesn't matter if a man "passes" as a woman. If he says he's a woman, he is a woman, and anyone who questions that is a transphobic bigot.
So take the example of the trans activist Alex Drummond, a man who says he's a woman, who has a full beard (and in order to grow & maintain that beard, I imagine is not on any kind of artificial cross-sex hormones). He looks like a man, but because he says he's a woman, we are transphobic if we stop him entering a women's single-sex space (single sex for reasons of dignity & safey, and because women are allowed to have boundaries).
Now what that does is lower the social barriers around any man entering women's spaces. Any man.
Let's spell this out even more simply:
Men commit around 97% of all sexual crime. Women & girls constitute around 85% of the victims of sexual crime.
Trans-identified men commit sexual crime at the same rate as men (because they're men).
We have socially sanctioned behaviours and conditions where we recognise that women & girls are vulnerable, particularly in places where they're dressing, using the lavatory, in medical settings, and in sports (men & boys are stronger & faster). In other words, society as a whole agrees to certain areas where women and girls are protected from the threat of male sexual violence and crime.
But now, any man can say he's a woman, and we are told we have to accept that. So our socially sanctioned ways of trying to protect women and girls against the virus of male violence are now under threat, and if people like you @Transperson had their way, would be removed totally.
Well, fuck that.
And it's not about "disliking" trans-identified men; it's about rejecting their behaviour and their sense of entitlement to destroy women & girls' boundaries and safety.