For some men perhaps them not being the object of the fetish means they're not really seeing the problem. Or are also reasonably sympathetic towards it, because they are that way inclined themself.
The advent of the Internet, and sharing your fetish, has emboldened a lot of men to be quite upfront about this. The sheer numbers of men with fetishes (not just AGP), is overwhelming.
I expect male fetishes are way more common than the general public realises. And I also find that men tend to be sympathetic towards other men and their sexual "needs".