Twat Him, not you obviously.
Is it actually happening, or could it be that he's just being mouthy, knowing that it will upset you? Is it worth finding out if you could lodge a complaint with the Police now, even if it's just so they have the details on record? I remember when all this happened originally, and it still makes me so angry. He's such a fucking arse (sorry, but I hate people like this )