The trouble is, now that you are SAHP, there is a BIG problem simply with the perception that 'he lets you have full access to his money' - IT NOW ISN'T ACTUALLY HIS MONEY, IT IS YOURS TOO.
That's the deal you've made - your are operating as a family, one person is taking on the job of bringing in paper money, the other taking on the domestic and childcare tasks. It is arguable which of these is the 'bigger' contribution in terms of paper money - but if you look at hours worked - it's almost always the one at home contributing more to 'Operation Family'.
So it has all changed. He has no right now to dictate that the paper money will stay in an account under his control, because it actually no longer belongs solely to him. Similarly, you don't have the right to now inform him that because you are the one doing the childcare, you will be deciding on bedtimes, schools chosen, etc., and that he actually has e.g. no right to have input on discipline etc. You may be the one actually doing it, but you're a family, and so he is essentially equal even if he's not taking on those tasks. So - the family money - you are equal, even if you're not actually taking on those tasks.
It can't operate any other way. So - the argument is, how will you both find an agreeable compromise on where your joint money is lodged and how it is funneled to where it needs to get to?
What seems to work best for most EQUAL, MATURE, EMOTIONALLY INTELLIGENT couples (:) ) is a joint account where all the family cash goes. All bills, mortgage etc. come out of this first. An amount for 'housekeeping' - food etc., stuff that can't be predicted to the penny each month - is set aside, maybe to a second account - you'd be the one using this card day to day to shop, etc. Another account set into savings account, if you're lucky enough to be able to! Then, the remainder is split equally between you to your personal accounts for fun spending that isn't really any of the other one's business, and from which you can argue quite happily over who gets to pay for that takeaway when the other one would be happy with toast, or pay for cinema tickets when the other one thinks it's a waste of money, etc. Small stuff.
Now - maybe you should show him the above and ask him what his problem is with having a logical, thorough, and EQUITABLE system such as that. And if it's 'me workmates think it's rubbish' - then ask him to look at the quality of relationships those workmates have, and whether that's what he aspires to.
Tip: if you don't get an immediately positive and thoughtful response from him, tell him you'll be going back to work and he needs to start thinking about his share of the childcare costs, an ironing service and a cleaner. Because the one sure thing is, YOU are the one taking a far bigger risk being the SAHP rather than the one being 'forced' into a joint account.