How did the EU or immigrants from the EU harm your quality of life?!?
Are you talking about increased competition? Shouldn't the answer to increased competition be... to be better than the competition, rather than just making sure they're not there (which wouldn't be good for UK businesses, if the talent goes elsewhere).
I understand people's wish of having the same life as, say, my parents: Single-earner household, dad worked 9-5, house, rental properties, great holidays, retired at 60, etc. Not much competition. I mean... I want that, too!
Doesn't work though in this globalized world, where you don't even need migrants to steel your job, because firms can just allocate your role to another country. I heard Gove talk about his ideal world. And yes, that would be doable, if every single country in the world does what he wants to do, too (possibly tax bankers, put a cap on bonuses, etc.) - which would be far easier to achieve, if we were part of some sort of union. If they don't, firms will just move operations.
I mean... France tried to establish a 75% tax rate on earnings over EUR1 million... and guess what... it was there for a bit and quickly vanished into the ether. Ever thought why?