This is purely xenophobia and nostalgia for good old days that never really were.
Not at all. What does "xenophobia" have to do with democracy?
I've heard it mentioned with reference to immigration, but even there it's an unfair accusation. If we're able to decide on migration within our own country, we could accept as many, or more, refugees and economic migrants as is currently the case. And that would be our choice.
There have been ongoing drives to reform the Lords and electoral system and yes, it's quite possible to support those at the same time as wanting to leave the EU and its layers of beaurocracy that remove politics as far as possible from the ordinary citizen.
As for the "good old days", if you're talking about a time when there was no Maastricht Treaty, euro, EU flag, unelected Commission or President Juncker, then yes they were better days in that respect. If we hadn't joined the EU, then of course things would have progressed to the present day, arguably more beneficially than they have in the EU. Like other non-EU countries, we wouldn't just have stopped in 1973!
Brexit is about looking forward, to a better future that we decide ourselves. There may be some small downturn in the economy but no more than our country has survived before (and no, I'm not well off). People ask "what does leave look like?" and the answer is that it will be what we make it. If we don't like the laws of our land we'll be able to get them repealed, and vote in a different government, rather than all Westminster laws permanently replaced by EU laws in which we only get a fraction of a say.