At some point we're all going to have to drop this remainer vs leaver positioning. Not to get too tinfoil hat about it all, but divisions like that play right into the hands of those for whom a deeply divided populace is an ideal situation.
Personally, I wonder if Brexit will force the conversation around automation, which is actually the far bigger issue that no one is talking about. For example, if farms can't get the labour to pick fruit they either automate or fold, because no one is going to pay £12 for 500g of strawberries. I also wonder if the UK manufacturing industry will shrink too, as it'll just be cheaper to buy everything in from China. Actually, outside creativity, care and instructional professions (teaching, tutors, trainers) there aren't many industries that are likely to be unaffected by automation. We - and our education system - need to be preparing for this.
Oh and as for immigration, that's the biggest red herring of the lot. Immigration is economically vital to pay people's pensions and healthcare, especially at the moment as the baby boomer generation is so large. We will simply source people from elsewhere. If I was a nurse, care worker or doctor from Nigeria, India, Australia, Brazil, Russia, the Philippines, Turkey etc etc I'd be feeling cautiously optimistic about UK job opportunities over the next few years.