Leaving the EU has undoubtedly cost the economy. But rejoining the EU is probably no longer a realistic option.
The Leave campaign never offered up a defined (and agreed with the EU) plan on what Brexit would look like, other than Theresa May's Brexit looks like "red, white and blue " which wasn't overly helpful or clear.
The same problem will happen with rejoining the EU - what does it look like, what terms etc etc. So it's not that simple.
Also the uncertainty, debate and protracted negotiations over Brexit sucked 5 years of political attention away from more important economic issues. Any attempt to rejoin will run into the same problems.
And lastly economically the EU is in a far weaker position than it was when the UK voted to leave, so the benefits of becoming a member again (and yes there are benefits) are not as great as they once were.
So in short yes leaving the EU was a colossal economic self harm, but trying to rejoin now would probably cause more economic harm than benefit, certainly over a 10 to 15 year window.