I'm going to go against the flow and say why not consider it, you don't have to make any definite decisions, but look into it.
Looking at your figures, you seem to have potential equity in your house of about £110,000. In Swindon or North Wiltshire (since that's the area you mentioned and you have family in that area), you could get a 3-bed terraced or semi-detached house in a decent area (not rough part of town or anything) for anything from £150-180k, depending on what exactly you went for. That's a huge saving in terms of mortgage.
Factor in a potential saving if your husband could get a local job, and that's a lot of money you wouldn't be spending.
So what I would do is start semi-seriously looking for jobs for your husband. Swindon and the surrounding area has massive potential for jobs in most business areas, and salary levels should allow him to get a similar wage to his current one.
At the same time, explore the potential for him to work from home more where you currently live, to cut commuting costs.
That way you're still keeping all options open. If a good job comes up, you'll be in a position to make an informed decision. If not, you've still tried and hopefully you might have cut your commuting costs where you are at the moment and that might just make life that bit easier and more manageable.
Looking at moving isn't committing you to doing so, it's only one option and why not consider it?