While I have empathy for the trauma of growing up fearful of scarcity, I also have to say that from the other side of this, it's very difficult to live with.
I grew up comfortably middle class and DH grew up in a council flat with his mum and although he had clothes, food, housing, etc, he was always acutely aware of how much his mum struggled as a single parent with no money.
Now DH earns six figures and we have a nice nest egg, lovely house, two cars, etc. But he will still eat food that has gone past its use by date, for example.
What I find particularly stressful is if we need any work doing to the house, it is a whole year of me begging, pleading, trying to make a reasoned argument, flat out fights, before he will agree to spend the money. We didn't replace our 30 year old bathroom until the floor was literally rotten and the bath sunk through it, even though I had been saying for years it needed doing. We lived a while year in our house with bare floorboards because it was such a struggle to get him to agree to putting proper flooring down.
He recently did as you are doing OP and freaked out about an upcoming holiday and insisted we cancel it. It was only when he saw how devastated the kids were that he reluctantly agreed to rebook it.
I get so annoyed with him having a go at me if I run the tap in the kitchen sink for what he feels is too long, or if I have a shower and he thinks I've taken too long in there he will say something. Similarly if I accidentally leave a light on upstairs for 20 mins, I hear about it for days. He's not being controlling, it's his anxiety. I tell him to shut up about it, but he can't help himself.
Honestly, I love him but living with his anxiety about money is exhausting and I wish he'd address it.