So you get an equal amount of disposable money, for fun or luxuries.
You have saved yours and want to go on holiday.
He has (presumably) spent his, so can't afford holidays, so thinks you shouldn't go on one either.
Is this correct? If so, he is a controlling arsehole.
Did you save up for the holiday out of your monthly 'luxury money'? Or did you already have separate savings from before the current arrangement?
If you had separate savings from before, that muddies the waters, but I think you should still be able to spend those savings how you want because at the time you were also paying in a higher amount than him to the joint.
You say: I was paying a larger split of the bills and mortgage to compensate for the deposit.
That is the wrong way to look at it, because his deposit is protected, so it is irrelevant to regular income and spending. If you split up, he would get his deposit back even if you had paid extra into the household for decades.
You should not pay a higher monthly share because of his deposit.
The only reason for you to be paying a higher share is because you earn more. Most couples either pay into a joint account proportional to earnings, or pay everything into the joint and then transfer equal 'fun' money into their personal accounts.
But bear in mind that you are not married (you say DP not DH), so it is questionable whether you should pay a higher share or whether you should both pay 50/50 into the joint account.
If possible, I would start to save up an amount equal to his deposit from your allotted disposable share, then in a few (or many) years use that to pay down some of the mortgage and get the deed of trust re-done so that you and he are then absolutely equal in what you have contributed and what you own.
But at the end of the day, if he is being petty and selfish about money, the relationship is not good. He should be happy for you to holiday with your parents if he really loves you, not jealous.