Your husband needs a wake up call about what he fondly imagines is “his” money. As others have pointed out, assets are owned jointly in a marriage.
As for him saying you don't contribute, present him with a monthly bill for all the services you provide, including childcare, cooking, cleaning, laundry, plus loads more, and tell him that this is your contribution that facilitates him working, and it would be counted as such in the divorce court.
Also, tell him that household maintenance and decorating isn't included in your housekeeping contribution, so he'd better start contributing to a decorating fund.
And don't be coerced into working more hours AND still doing all the housework and childcare. Does he do any of this at all?
If you increase your hours, I hope you do it to amass a leaving fund, but in any case, he will need to contribute to a cleaner, childcare and do more around the house.
He sounds bloody horrible and bullying, and I do hope that you will feel empowered enough by this thread to put a stop to it, or else LTB.
You could practice a bit by telling your obnoxious neighbour to fuck off, you've heard it all before.