Feminists often talk about "unearned privilege" when they talk about class. I think it is a useful term, especially as the notion of privilege has been hijacked by identity politics.
Unearned privilege is the reason why there are disproportionate numbers of men in positions of power and mediocre men in high flying jobs being supported by a wife and a female PA. Unearned privilege is also the reason why men as a class do not do their fair share of housework and child care.
So yes, it may seem ridiculous to talk about poor men in northern England as "privileged" but the chances are that even these men have "unearned privilege" or at least an expectation of it as they probably have a mother or a wife who washes their pants and makes their dinner. They also probably get to be a parent whilst doing less than their fair share of parenting because a woman will be doing the heavy lifting of parenting.
This is what feminists mean when they talk about men as a class having privilege. It doesn't mean they are all privileged in the general sense of the word. It means they get paid more, get better jobs, have more power, have more freedom, etc than their female counterparts and most likely have a woman in their lives doing wife work.
It also means that they are much more likely to use prostitutes than be prostituted, to abuse their partner than be abused, to see themselves portrayed in popular culture and the media as having control, power and status than as powerless or as a victim, etc, etc.
It is still very much a man's world and that is what unearned privilege means.