I am a bit ignorant about this. I don't understand it. I certainly don't understand the comparison with black people, gay people, etc.
If people behave in a really deliberately offensive manner then they don't deserve any respect.
You can be offensive without intending it, but leaving shit all over the ground for other people to clear up is very clearly going to upset everyone.
We have a large local site which seems to tick over quietly. I've had stuff stolen, and the police knew it was them but would, or could, do nothing. I've been chased by dogs walking past another smaller site. But we just keep away now.
In short I think it is wise to allocate a site and provide facilities. It seems to be, give them what they want and they will leave you alone, which doesn't seem quite right, but it works, roughly speaking.
I am sure there are pleasant and reasonable people among the community and there must be reasons why they behave badly at times but I don't know enough about them to comment.
Asking on one hand to be seen as a homogenous culture, and at the same time not to be labelled with cultural behaviours that appear to prevail, is a difficult one for me to get my head round in this instance.