OP, you are a maturing woman who wants to evolve from being a people pleaser, and I really commend you for that.
Invariably people pleasers are concerned with how they feel primarily, and what makes life more comfortable for them, and not of those closest to them.
You have clearly been woken up from this and want to assert yourself, for yourself, and for your child.
Your husband is irritating you because he is absolutely putting himself ahead of doing the right thing for his child.
I hope you work and will continue to be financially independent.
I think that is very important for you.
As you mature you may well leave your scared husband behind, your feelings may well change for him, as you realise you are not a real team whom has each others back.
As the children grow and you see other issues like this your respect for him will be chipped at and your love will diminish.
These things happen slowly and you realise you are actually the only real adult in the relationship and your childrens father is a scared little man that will deny things happened or pretend not to see things, absolutely a form of gaslighting IMO.
So protect yourself, because long term, losing your respect for your partner is terribly damaging to a relationship.