Sanjeev I think you'll find there are plenty of people on this forum who are very aware of how various forms of discrimination and privilege intersect to cause the social problems we have. In fact, feminists and other activists for social justice have a term for it, Intersectionality.
There's some more info here and lots of feminist and womynist writers use about it.
When you say Sometimes the feminist chat on here is rather bleak and depressing, as though the women here believe that every man is actively involved in subjugating every woman. And that is not the case. it sounds supiciously like you're trying to tell us to cheer up because someone else has it worse than use. Which is a silencing technique often used to stop feminists talking about womens' liberation, but trust me, will not work here.
However I am a helpful sort of person and so, as well as giving you that bit of information I will give you this. We believe that patriarchy is an institution that has successfully infiltrated all aspects of our lives after thousands of years of practice at it. We don't think that " every man is actively involved in subjugating every woman" - a ridiculous thing for those of us married to and raising men to think - but we do know that every man is able to passively benefit from social subjugation of every woman. Hence our insistence that every man in our lives actively resists patriarchal influences, so they do not passively benefit from the subjugation of women.
Don't believe me? Think about a slave in Jamaica in 1850, and a coal miner in England that very same year. The white British coal miner isn't personally enslaving the black plantation slave, is he? He's not buying or selling that slave's family, he's not personally wielding a whip. But does he passively benefit from the British kidnap and enslavement and murder of generations of African citizens? You BET he does. In 1700 sugar was still a luxury commodity. In 1850 the coal miner can afford to have it in his tea three times a day. His white privilege means he passively benefits from being white, even if he lives his whole life without uttering a racist remark or harbouring a racist thought.
The poor man in your (rather sneery) generalization above is indeed socially above any woman in his exact socioeconomic class, because of the patriarchy, he has male privilege. There's no point comparing a white binman and a black doctor who is a woman, that's slinging in too many variables. Compare a white working class school leaver who is male with a white working class school leaver who is female, and there you see inequality. Compare a black woman surgeon with a black man surgeon, and there you see inequality. I agree with you that male privilege is one of many demarcations of unjust advantage and subjugation, but I am not going to take that as a suggestion that I should therefore cheer up and stop being 'bleak' about sexism, because male privilege (and women's liberation from it) is the one this forum exists to discuss.