OP, this £2.5K income you get every month into the joint account, where does it come from? I.e. Is it your income or is it from another business/benefits/whatever? Who is the income attributable to? And if you removed it and paid it into your own account, would that be pheasible?
There is no doubt that there is inequality in your financial relationship, I.e. That he has far more access to money than you do. But equally £2500 is an awful lot of money to be paying out on food/clothes every month and regardless of the fact your DH is removing money from the joint account, you are still paying out that level of money on items which aren't household bills because you're putting the money he's taking out on to the credit card instead.
There needs to IMO be separation between the relationship between you and your DH which clearly is not a good relationship on many levels, but also you do need to look at what you're spending to see if you can bring this down. Interest on a card is a waste of money, so if you have money in an ISA I would suggest removing that and paying off your cards in the first instance.
But how much are you e.g. Paying out on food/clothes etc? This isn't as black and white as saying the bloke is financially abusive and the OP has no access to money. The OP is still spending £2500 a month and there are no bills included in that expenditure.
If the OP leaves her DH she will need to equate for bills as well in that amount.
It does sound as if there is abuse here, but it also sounds as if neither of them is particularly good with money, and that is something which both need to address, be that separately or together.