TLDR: The flags are a stand against the illegal immigrants, the ones who endanger others. See screenshot. Not the guy who runs the takeaway, not the woman who married a British guy and raised a family here etc. It's to put a stop to people like the one in the screenshot... Then getting away with it because 'he didn't know he shouldn't rape children.'
I have Polish and Ukrainian neighbours who have Union Jack and/or St. George flags on display.
I've became friends with the Polish woman and as the conversation went, she's against the illegal immigrants. She doesn't feel threatened by the flags, she loves them. She feels, as many others do, that it's unfair that she, a hard working, came here legally, woman, is being made uncomfortable by random men who seemed to have just turned up from nowhere.
The men, who have no ID, who stare at her young teenage daughters as they pass. The men who, if they ever did anything sinister, would probably be nameless and faceless to ever bring to justice. I'm with her, she's with the many, many others who feel the same. It's not about a divide of England VS The Rest Of The World.
It's British people who were born here, who earned the right to move here, who don't want to feel threatened in a place we call home, against men who don't know or care about our culture. The illegal man who hurt two girls here, stating he didn't know he couldn't do that!! That's who the flag is against. Not anyone who is here to fit in or atleast, do no harm and who pay tax etc.
So no. The flying of flags, atleast around here, are not all from racists. It's not about skin colour. It's 100% about behaviour. In my small town, it was mainly whites as I grew up. Now, we have many Turkish (takeaways and barbers, always busy businesses,) blacks (they have many white friends in the schools and are often seen in work uniforms) Indian, Chinese, Thai... There's never an issue with them. But there is an issue when men who no one knows, or have seen before, start following women. It's caught on video and camera.