I feel for you OP, as I've been there and done that.
You living in temporary accommodation is actually your blessing in disguise and use it as the "get out of jail free card" that it is.
I would go back to the council and explain to their homeless duty team that you need to be moved somewhere else. It could be hard as they often need a paper trail i.e. police reports etc. It's unclear if you've reported any of this.
If you don't have any paperwork. You should file a non molestation order and try to get that served on him. In the meantime you should contact women's services who can support you with this and help to fight to get you moved somewhere safer.
It's pointless remaining in this temporary accommodation flat and dealing with abuse, until your properly housed. The other option is to move in to a refuge, as either way you're still waiting to be housed. But at least with the latter, you'll be safe and finally gain some peace and mental clarity to just breath and focus upon your life.
A PP was a bit harsh in stating and I'm paraphrasing that you're wrong to bring your baby back around an abusive "man." But I agree. Sometimes we can't do it for ourselves, but as mothers our driving forces are often our children.
Children are forced to live whatever lives their parents choose. They have no choice- until there is an intervention (if lucky). This is not a criticism, it's reality and something to be mindful of. It can impact upon your future relationships with your children. It did for a while with my eldest.
You all deserve to live peaceful lives and initially it will be hard. But once through that tunnel, there's such a better life to live- free from him and most importantly free from abuse.
2 years from now- you could be living free, peaceful with a new home and laughing at how far you've come or you could be sitting in an office debating with social services, or filing the 12,345 police report- looking haggard and stressed out trying to argue why they need to now take your reports seriously. Choose your struggle and choose it wisely.
Find your fire that you once had and use that to fuel your strength, to pick yourself back up and fight for your lives.