I've read more of this and the stand outs are:
"He says it's too hard because he knows all the owners personally and the company doesn't have the money so they might lose their houses etc. "
And also him having his head in the sand on spending and what your mortgage is.
OP, forget about luxuries.
On the first point above, so what if they lose their houses, you are a creditor and are due that money back. Take legal advice on it and if necessary go to court/ get a court order for payment / bailiffs if necessary.
The second point is a major husband problem and this, more than anything, needs addressing. Get angrier with him and force the issue, this attitude and his unwillingness to see the real picture is relationship ending territory.
Does he want his family to struggle and suffer?
And why the hell is he not stepping up to get a better full time job or work more hours?
If you have to, sell and move. In the long run the financial pressures will build up too much and tour health will suffer. Don't let it get that far.
This is a really life changing moment, sorry.