The level of violence within your home is a direct threat to your children's safety and wellbeing.
When he has punched you repeatedly in your face, he does not care who knows that he has hit you, your shared children, neighbours, friends or family. The shame of being known as an abuser of his wife is often what stops men from hitting in such obvious areas, he does not care about that.
I say this not to be over dramatic, but domestic violence incidents get worse, then worse, until women, and often times children are killed in their home.
Given that he fears no one's reaction, not family, not friends, nor police, or even that your children know what he has done to you, I would be surprised if you let him back- if you were not put into critical condition, or killed within your home in 12 months time.
You have almost broken free. Please for your children, if not for yourself, do not accept him back in.
Get all the support around you that you can, ensure that you have the best security on your home that you can have. Ensure he isn't allowed around you, and speak with social services about what should/could be done to protect your children from their father, as he is a violent man.
Wishing you all the best.
Also, don't ask, get a divorce.