When I shared a house as a post grad student, a young housemate locked me out.
(Not intentionally, most of us housemates didn't come back to the house during the day and he thought that would continue to be the case but that day I needed something so went back at lunchtime.
(Turns out he was always in trouble with somebody and had had ex "friends" come to the house and got into a physical fight on the doorstep, he was scared they'd come back and force their way in, and didn't trust the basic lock on the old Victorian stained glass door, hence using an inside bolt on the outer door. No e if us realised he was licking us out during the day before just through chance).
That single incident alone, where it took a few mins for him to open his bedroom window and "discuss" coming down to unlock the outer door - resulted (naturally) in a big argument, and relations not being the sane again.
This is your husband!This is your home! This is more than once! Thus is due more than a few minutes.
And on top.if all that he is licking out children! Which is actually a welfare issue, possibly abuse.
Absolutely disgraceful, disgusting behaviour on his part.