OP, you need to find out how much is in the joint account and how much he has in savings.
You've been given a house and you both work, you say he doesn't spend money and he won't let you spend money, do you must have loads of money left over, as you have no housing costs.
There's either thousands sitting in the current account or he's moved it into his own account.
As for the savings you received from your DM, I'd not consider spending those, more regard them as security for the future, especially if they are an investment product, not cash, as there could be penalties. Do you have a pension?
Between you, there should be money available from your wages to pay the bills, buy food, save for annual and irregular expenses and have some leftover for routine personal spending. So it's reasonable that you both take an amount to spend or save as you wish, eg £2-300 pm.
Does he have a plan for all this money that the family is earning but not spending. Life is for living, you have the basic security of a paid for house and financial assets on top. There's no point saving up to be the richest person in the graveyard.