There is no such thing as "the polyamorous community".
The very word polyamorous - an ugly confection of Greek and Latin - was, according to Wikipedia, coined fewer than thirty years ago by a barmpot called
"Diana Moore, subsequently known as Morning Glory Ferns, Morning Glory Zell and briefly Morning G'Zell, She was a Neopagan community leader, author, lecturer, and priestess of the Church of All Worlds. An advocate of polyamory, she is credited with coining the word. With her husband Oberon Zell-Ravenheart she designed deity images."
Polyamory seems to be a term used to convey a degree of dignity on a lifestyle which seems to possess very little - it seems to consist mainly of shagging around - and the children of polyamorous parents would seem to be susceptible to neglect for the simple reason that their parents will be bound up running their needlessly over-complicated lives.
Personally, I don't care how people arrange their relationships if it suits them, but I don't think they are entitled to complain when their actions put children at risk of neglect. Certainly, the OP comes across as over-entitled, but that's probably just me being lower middle-class.