I always assumed it was more about the symbolism, a bit of a provocation - a reminder of how easy and dangerous it is to assume male = default, and to flag that this (group, place, conversation, paradigm) is a consciously feminist one.
(I think the same of "herstory", which I know also sometimes upsets linguists!)