I think the fundamental problem here is that you and your husband clearly have different priorities and views on life and parenthood, and you need to seriously sit down and discuss this ASAP, and to find a compromise. It sounds like you think it's more important to spend time with the children when they are young (note: this only benefits you though in the couple, since he may well have to spend more time away from the children to bring in the required income). He may be thinking it's more important to have a financially secure future in the long term. Neither of you are wrong.
Contrary to what some posters have implied, there is no "RIGHT" way of balancing work and family, and someone not wanting their partner to give up work is not "selfish" or "dickish". Everyone's circumstances will be so different that it's impossible to have a one size fits all approach.
You ask why some men are happy for their wives to be stay at home whilst others aren't. Well, it's not really very complicated - everyone is different! Some couples will share the view that it is very important for their children to spend their younger years being looked after by a parent, to bond with them, to ensure that they are being looked after in a particular way, whatever, and are prepared to make financial sacrifices to do that.
For others, the cost of childcare would simply be impossible to balance if both parents work full time. Charging around £1000 a month for full time care is insane, but not even an exaggerated cost. Now imagine you have twins, or siblings born fairly close together. Even with a (laughable) 5-10% on the second child, most families aren't going to be able to cope with those costs, so unless you are lucky enough to have close family nearby who are able and willing to provide childcare while you work, there is no choice.
Cleaning, bills, diary planning, appointments etc aren't things that only uniquely spring into existence when one parent is stay at home. Thousands of couples who work full time have to do those things as well, and don't contribute them to some list to justify their contributions to the household. It's bloody rare that any couple will bring in a paid employer to do those things, so you aren't exactly saving any money in that respect.
One compromise would be that you work part time. That way you still get to spend lots of time with your children, but you also keep your toe in the employment pool. That way when you do decide to go back to work full time, you aren't starting from ground zero. A huge number of women find it difficult to get back into decent jobs after extended time away from the workforce. That isn't a myth. But if you keep working even a couple of days a week, then you will be in a much better position.
Financially, it won't help your household at all. In fact, it will probably just about balance out the cost of the childcare you will be using. But in the long run it's a very sensible idea, and it gives your husband reassurances that you will be able to go back to work in a few years, and he won't be stuck being the sole wage earner for the rest of his working life.