Firstly .... Omg!!!!! I’m so so so happy for you!
Secondly, this is totally the bit where all of the doubts are going to come out, of course they are, you are making a change. But you are making the right change. Nobody on here thinks that you are exaggerating or anything like the thoughts you are having.
Also the woman at the refuge listened to what we know is a fraction of what has happened to you and your children. Did she say, no sorry you can’t come? No she agreed the place. Don’t for one minute doubt yourself (easier said than done).
We will still all be here for you, just like we have been for as long as you need us 
.
Please write everything down, make a list of everything you have told us so that you can show them - I remember how it went when you asked the SW to look on here. There is so much evidence and it will give them a complete view of what has happened - especially if you see a counsellor - which I would recommend, it helps so much.
Just keep think about what you would say to your daughter if she was in this situation, or a friend.
Keep thinking about how free your children will be to enjoy themselves without fear. How you can go to bed and not worry what is going to happen. Those days you enjoy when he is in work because they are less stressful for everyone, make that your future everyday.
And please remember that those good days that you have with him are designed to keep you there. Just think how quickly you would have left if he was constantly doing bad things... abusers are not daft, they know they have to mix the good in with the bad to keep you.
They know when they have pushed you and made you upset, so they switch tactics for a day or so before they start again. In my experience the worse they do, the longer the gap is, so you have time to ‘get over it’.
You have been so unbelievably brave so far, you can do this