Firstly, I agree you should not see him ever again, because of all the reasons given upthread, making out the ex is mad, lying with his entertaining, fascinating and witty anecdotes etc.
Seconldly, I am no expert, and would be feeling in a dilema as to how to get rid of of him. I too feel fine on my own, in fact relieved and overjoyed to have finally escaped from an abusive man.
The kindest thing if it was it was a nice man you were dealing with would be to just tell him what was said upthread, nice to meet him, don't want to persue a relationship. But wondering if you tried that he would start with trying to persuade you to carry on going out with him, try to make you give a good reason etc.
So if you feel brave enough, I suppose you could ring him and tell him you don't want to persue a relationship, or say that next time he rings. If you don't feel you could do that, or you do and it doesn't work, go to plan B:-
Would it be terribly awful to tell him by text or email that you don't want to persue a courtship with him (not using those words,sounds sarcastic).IMHO Not saying too busy right now or anything because then he'll hear twist it in his head, to mean you like him really, so there is hope, so keep pestering you, thinking, like in romantic comedies, you will eventually realise he is God's gift to women, you are ideally suited, etc etc.
If you'd been going out together for a long time, the text or email route would seem on a scale between not very nice to cruel. But with the type of man he is and length of courtship, IMO, especially if you don't want to speak, or do speak and it doesn't work, texting or emailing would seem justified.
It would stop you cringing when the phone rings/having to buy a new 'phone, having to give him reasons, (which btw, why should you, it's not a job interview feedback), and make it so he's not left wondering.