In life we are meant to make mistakes.
You made one.
This doesn't make you an idiot. Just human.
What could make you an idiot (and a coward) is ruining your life by not facing your mistake and changing what needs to be changed because you don't want to feel like an idiot.
No judgment, I have done that, when we made the wrong choice in our life for ourselves (partner, job, money...) and rectifying it comes with some hardship, and loss, it can be easier to try to live with it.
However difficult it is to make the change, it never comes with regrets.
It's a bit like you are overweight, your health is impacted by it, and you're unhappy with yourself, your appearance, being unfit, everyday.
Eating comfort food can make you feel good for a bit and forget it, but you will always regret it for making your situation worse and for mentally acknowledging your weakness.
Exercising is hard, painful, tiring, and throw into your face how unfit and fat you are, it is not nice at all. However I have never met anyone who came to regret having done some exercising. If anything we're always wondering why we were so reluctant to do it, right?
We can't always pick the road of the efforts and the change, we're humans, there's a lot to cope with already with daily life, we need comfort as well. We live mad lives, in an environment completely unfit for our needs, let's not beat ourselves for failing here and then.
However now and then some efforts/changes become a necessity.
You're asking about it right now. Maybe it's not to that point yet. Maybe you need something specific to happen for it to click and take the decision "that's it, we're moving, whatever the cost".
When it will feel like a necessity, the only regret will be to have not done so earlier. But its ok, thats your path too.
When I was in the process of destroying and rebuilding my entire life to extract myself of abuse, my sister said a very wise thing.
"Peace has no price"