OK Vivee - time to take a deep breath and say that if he is not prepared to respect your 7am, then the morning visits STOP. TODAY.
He is harassing you and trying to ram rod you into doing what he wants you to do. NOT for the kids, not for you FOR HIM, only for him. He is being utterly selfish and it is unacceptable.
Tell him that no matter WHAT he says, you KNOW counselling would be inneffective, and in fact any decent counsellor would refuse to see you as a couple.
Tell him if he wants to fix his abusive behaviour, then HE has to find that path. His life is nothing to do with you anymore, and that is fine with you.
Tell him that you are not going to spend a holiday with him, nor a single night under the same roof, under any circumstances, and that that will be the last word on the subject.
If he refuses to respect your wishes on this, again all contact will stop, as it is detremental for your children to see you being manipulated, controlled and bullied like this, and you won't let it happen. You have managed to remove him from your home, and now you are closing down his supply of victim.