carla, I don't know the history here.
Is Relate or similar an option?
Alternatively, can you plan to kick him out and stick with it?
I'm worried he's got the message that he can put you through all sorts of rubbish, and you might kick him out, but you won't stick with it, or do anything if he breaks back in ...