People from ALL parts of UK society, all races, classes, ethnic origins, beliefs and political persuasions voted for both "leave" and "remain".
They all had their own reasons for doing so which varied enormously from person to person. Most, apart from some very unpleasant extremists and silly impulse voters, meant well.
For example, I know of one lady, who is black and a devout Christian, who not only voted "leave" but campaigned for Brexit. I know of someone else, a white British born man who holds a lot of sympathy for UKIP's views, who wouldn't dream of voting any way but "remain", because he believed voting "leave" would damage our economy.
A lot of people, myself included, voted "leave" but now regret it, as we were voting tactically to send the establishment and Brussels a wake up call, but thought "remain" would win. I believe many people have voted with their hearts not their heads because frankly the information given by BOTH sides was poor quality.
To answer the OP's original question, if all "leave" voters are racists, does this mean all "remain" voters are communists...?