It strikes me that there is a real need for a voluntary organisation - or just loose agreement - of women to support others women who are going through this sort of wearying, spiritually demanding shit,
Many women have spent years being controlled by abusing men. The control is often subtle at first, and the women don't realise what is happening until it is too late - often by then, they have been cut-off from family and friends, have lost their confidence and courage, are physically, emotionally and spiritually exhausted and are literally terrified every time the phone rings, or the doorbell chimes.
I'm not talking about a baying mob of women who would slice his balls off - though many deserve this - just two or three who would provide moral support and act as witness to any inappropriate behaviour on the man's part. Or indeed the woman's - this must happen in gay relationships, too, and we all need to know that we aren't on our own - that there is at least one person on our side, who will hold our hand if we need it.
I've been through an abusive relationship myself - you would not believe (unless you have experienced it) how difficult it is to mentally cope with it - and often people's physical health is broken, too. I still, 40-odd years later, feel physically sick at the thought of accidentally running into him. I never have, but If I see someone who looks like him my stomach turns over and I can feel myself shrinking mentally and physically. It affects me for days - weeks - afterwards, leaving reliable to burst into tears at the slightest thing, giving me nightmares etc.
OP- please PLEASE don't let him into your home. Pack up his stuff - have it waiting for him OUTSIDE the house. Tell him that if there is anything missing to text you and you will look for it - or just say it isn't there and he must be mistaken. Have someone with you (would a neighbour sit with you- even this would be comforting and provide you with a witness).
DON'T allow him in the house alone - he might damage electrics or anything to cause a small fire, or plant drugs - he sounds unhinged, so you have no idea what stupid malicious actions he might take.
You've been given good advice form many people on this thread, a lot of whom have been through it - learn from their experiences. He'll never change - you've done a great job severing your relationship, do as Juells sisters advised and let it go, no matter how much you need to prove to yourself he's doing this. It just isn't worth it.
Walk away - he knows he can still rattle your cage and this excites him and re-inforces his power - don't give him the chance.