Op, you really need to take control.
He should not be calling the shots here, he is nothing but a bully.
I understand it's not easy for you. He has knocked all confidence out of you and ultimately taken away your independence over the years.
But you need to tell him to go, tell him you're keeping your much wanted baby
Don't wait for him to decide when he's leaving.
Your children won't respect a man who doesn't acknowledge their youngest sibling, your husband is nothing but a manipulative bastard who has you knocked down so much that you can't make any decisions.
Please decide to tell him to fuck off and that you and your six children will be fine.
I am one of 8. My mum also had 3 miscarriages. My dad left her every other year and finally she turned on him and threw him out. You can and you will be able to so this on your own.
What age are your children? Are there any teenagers among them?
I'm the youngest and my eldest sibling was 15 years old when I was born, we all made a great team. Years later I have no contact with my father - and yes, I feel a bit of resentment towards my mother for not leaving him years earlier.