He has no personal money anymore (his salary is paid into the joint account).
Debt or no debt, this is unsustainable and a recipe for future trouble. How will he buy himself anything? The odd coffee, a three-pack of underpants, a new razor, even your birthday present? Does he have to buy your present out of the joint account? Does he have to withdraw cash from the joint account to buy personal stuff?
I think you need to go back to the drawing board and start again with a new financial set up, whereby both of you get a sensible amount of personal allowance (the same amount each), the debts are paid from the joint account, and you build up some joint savings. It will cause resentment if you have more spending money and more control than him.
It is tough when you are earning so much more than him that it feels like you are propping him up and supporting him - the only remedy to such feelings is to truly appreciate all that he does around the house - assuming he is actually pulling his weight at home and not being lazy - and recognise that you are a team in this marriage for the long term together.
Your issue with his past actions is a separate matter to your current financial set-up. Try to draw a line between past and present, maybe get some counselling, but only if his current behaviour, financially and work-wise, is not causing ongoing problems and resentments.
OTOH, if he is currently causing ongoing resentments, consider splitting up.