I didn't reply earlier because you had gone quiet and I was too cross on your behalf. So I am going to have a little rant now, that you hopefully won't even bother with because you are cuddling your new born!
I had several babies, many years ago, all in different hospitals to each other.
All the midwives I had over the years treated mothers (and particularly their babies once born) as if they owned us and our babies.
They don't.
I'm afraid it doesn't matter how nice you think your midwife is - unless your husband knowingly has Covid or Monkey Pox - they should let him be there. He obviously hasn't got a contagious illness, or they wouldn't have said that he could come back in when they decide it is ok.
As well as not owning you, or any of your family, they don't own the hospital either.
It is a public building, being financed by the public. They are doing a paid job, in that publicly financed building. It is their place of work. Nothing more. Nothing Less.
None of the midwives there have the right to tell anyone's partner to go home, unless they are disrupting the other expectant Mums, or are actively getting in the way of the midwives doing their job. Please tell 'your' midwife that you are very distressed, and if your partner is not allowed back immediately you will be complaining to PALS, and the official complaints department at your hospital, as soon as they are open, and that as soon as you are back home you will be highlighting this policy with your M.P.
Having been a hospital nurse, I can tell you that that Dr's and hospitals actually take an M.P.'s involvement very seriously.
I am sure that to start with you will be very friendly while you explain to your midwife how distressed you are with not having your partner there. If she does not change her mind at that point then you need to tell her who you will be making complaints to in the morning. You should emphasise that you feel sure that your labour has slowed down because of how upset you are, and point out to her that her job would actually be easier for her, and safer for you and your baby, if your partner was there supporting you.
If she doesn't agree she, can explain why at her disciplinary hearing - but keep that last bit until she still stubbornly refuses to let your partner be there. I would be very surprised if she let it go that far.
In case you are worried that if you complain they will be nasty to you, or put your baby at risk, they really wouldn't dare (and hopefully they wouldn't want to). This is not a case of a chef spitting in your meal.
Good luck @GoTraine with the rest of your labour, and when baby arrives forget all of this neglect for now - but please don't forget once you are home and nicely settled with your baby. xx