To answer your question clearly - yes, it’s financial abuse and you are not spoilt.
You make it possible for him to earn that money, you aren’t freeloading. I’m looking to go back to work after being a stay at home mum (I had access to our bank account and never needed to “ask” for money, though we always discussed big purchases, whoever made them). I would have to earn about 80k to pay for someone to do everything I do at home that my DH doesn’t - childcare, school run, general chauffer, cooking, shopping, cleaning, organizing, teaching, gardening, laundry, picking up all the pieces that everyone else drops. Of course when I go back we won’t hire people to do all that. Our Quality of life will slip in someways and we’ll all pitch in and cover the rest. In return we’ll have more cash to spend which will increase our quality of life in some ways. But I have in no way been freeloading while a SAHM.
In your case when you go back to work your DH isn’t going to pick up any of the slack is he? Is he going to expect your wages to help fund family expenses while he fails to pick up any of the domestic load?
You haven’t said how you feel about him? Do you love him? Do you like him? Is he fun to be around? Do you look forward to him coming home for reasons other than that he’ll pay for a bit more stuff? I find it hard to imagine being happy to be with someone who is so unkind and uncaring enough to see his family struggle for money when he has plenty and is going on holidays without them.
I think you should find a way to get some legal advice (if you really have to, borrow money from family or get a credit card to put it on) to find out what your situation would be if you divorced. I think you would be in a much better position to pursue a job if you weren’t encumbered with this DH. The longer you wait to go back to work the weaker your personal financial position will be for the rest of your life and you do not seem to have the sort of DH that makes that likely to be OK.