You will be able to take the kids if you go into temporary accommodation. I misread your post initially as that so assume criminallawyer did too.
You can take them into a women's shelter, you can take them to a friend's sofa where you can only stay 2 nights, you can take them into a B&B, (temporary accommodation when it's just you and more than one child is more likely to be a small flat, though) you can take them to live abroad in a hippy commune if you like, it doesn't matter if he says "My kids aren't going to live in X" if you are looking after them, you decide. You don't even have to tell him if you don't want to.
Fideliney is right - you must assume that they are coming with you, and don't leave them with him whatever he says. That is the only thing that you could do which would put him in a stronger position.
Please please please understand that he cannot legally kick you out and he cannot legally refuse to let you take the children. But he is not a reasonable person, and he is not going to let you walk happily out of the door with them. While it is true that he is not in charge of you, has no power over you and cannot tell you what to do, he is going to act all the way like he is, does and can. That means you're going to have to fight some extremely ingrained conditioning and stop being reasonable towards him or expecting him to react in a reasonable way. The best way to avoid all of this (which is his fault, BTW, because he is not accepting that you have the perfect right to leave) is to sort everything out before he has a chance to kick off.
You do not have to tell him where you are going, you do not need his approval and you do not require his permission to leave. Don't wait around hoping that you're going to get it, because he's enjoying the fact that you are waiting for it, that gives him the power. Your relationship is over, and you don't have to listen to him or seek his approval any more.
If he does kick you out forcibly without the children, you stand at the door and call the police. But I would try to get everything sorted before this happens.
Whatever you do and whatever he says do not leave the property without your children.