Dixie, I hope as the days go on you find some equlibrium, with or without your husband. I think custardo's right about getting angry - I hope you can make that anger work for you to get you through this. It doesn't have to mean you're pushing your husband is out of your life forever. Even if angry, you can still say you're prepared to talk things through with him.
I don't know what your relationship was like before this, whether your husband was supportive, whether this is a temporary crisis for him or whether the seeds were sown a long time ago. I think you're so right to take things slowly for now. IME such confused situations need time to unravel.
Whatever else is happening, you have your children - the source of so much joy. Sorry if this sounds like a cliche, but to me it's true. As they grow up, my children have given me so much hope and happiness. They have become a source of strength. Like you, I have no family living nearby, and have recently moved to a new area. Without my children I would feel so much more alone. By leaving you all, your husband is cutting himself off from so much happiness, if only he could see it.
Glad you were able to post, Dixie. Thinking of you.