Dh wants to go to New York for his 40th birthday for a long weekend without the children. I've said that I really don't want to go as I wouldn't be happy to be so far away from my children ( aged 5,5 and 2), but he has set his heart on going, and says that if I don't go, he'll happily go by himself. Am I being mean by refusing to go with him?