Why can't she bring the dogs with her to the family do?
I agree with all the other posters. Get your OH to say no - with no explanations. It doesn't have to be nasty, just 'It doesn't suit anymore'.
Why should you have to leave your house because of such an unpleasant woman?