Ooh this is complicated and as others have said I think it is a microcosm of wider issues.
Looking at this from a pure accountancy perspective, ultimately you both agreed to contribute your fair share. I'm not sure it matters where that share comes from unless you have spent money you had told him was earmarked for another purpose, for example. It's interesting that you both agreed to SAVE for it rather than simply to PAY for it. I wonder why that was?
I do not come from wealth but I have a (weirdly large!) number of friends who do and ultimately their income from things like trusts is another source of income, just like a salary. It's a totally different way of being in the world / with money, I think, to people who are used to income equalling salary. A bit more akin to how people think of income from a pension, to compare it to something more people are familiar with.
But ultimately this speaks perhaps to a bigger issue, whereby his financial security and spending power has always had to rest entirely on his own hard work and prudence/sacrifice, whereas yours hasn't. It's hard not to feel resentful about that sort of thing in his position, and I don't think it makes someone a bad person if they feel that way.
On top of this, as others have said, he might be looking at this as an example of your wider inability to save. If he's seeing this as part of a general and perhaps future pattern of behaviour then it makes his reaction more understandable, given his personal history with money.
Equally, in his position, I might wonder why you hadn't used that windfall to put towards your shared costs of the trip, leaving you both with half the amount to fund out of personal savings. You are married after all. Shouldn't you share life's financial upsides and downsides equally?
Can you ask him to unpack why he's upset? It might be worth undergoing some joint counselling, as others have said, as there's usually a lot of complex emotional dynamics around money and this could be beneficial to your relationship long-term.