Probably the fact that he is male did help him Pistol.
Have you heard of intersectionality? It is the idea that people can be disadvantaged in a variety of ways, and that those disadvantages intersect and interact with each other.
For example, Buffy's FIL was working class, so that was an area of relative disadvantage for him, but he had male privilege, and if he is straight and white (I don't know this) then they would also be areas of privilege for him. So he would be working with only one area of disadvantage.
However, a woman in the same position would also be disadvantaged by her femaleness, and if she were disabled, or a lesbian, or non-white, then those areas of disadvantage would intersect to make it relatively harder for her to achieve the same class mobility that Buffy's FIL was able to.
These are issues which feminists grapple with every day. We don't just sit about hating men, but look to structural discrimination, and how we can work to create a fairer system for everybody.