It's racist to say that it's always hell when Travellers visit an area, as a generalisation.
It's not racist to say that one's own experience with Travellers has been uniformly negative. For example, every time Travellers visit my area, they leave a huge amount of rubbish and human waste, block businesses from operating and attempt to steal their stuff, there's an increase in burglaries, antisocial behaviour and violent crime (with pubs being advised to close by the police), dogs go missing (and, in one horrible case, one was found dead by the camp after they'd left - a few months old spaniel puppy that had been stolen a few days previously).
In a different area, my mother was targeted and conned out of hundreds by a traveller who persuaded her that he was a reputable gardener, and he harassed her each time his group rolled through town. The green next to my brother's house was covered in rubbish and filth.
It's hard for your heart not to sink when you see a load of caravans going down the road to the local park, knowing that it's going to be a no-go area for days, unless you want to be verbally abused, sexy ally harassed, and worrying about your dog, or your bike, and knowing that your council tax is being spent on the council sending in their environmental health team to clear up human shit amongst the rest of the rubbish.
I don't see why it can't be made law for the police to able to evict them straight away from illegal camps, whether it's on private or public land. We have a local traveller camp site, but they'd rather rock up on our parks, greens, commons, car parks and industrial estates.