Cheat
Coke dealer
Not very interested in his own kids
Jealous of time you spend with your kid
Doesn't cook or clean
Disgusting table manners
Poor hygiene
Yet you've said this: "Explained I need more help if hes going to be here and I cant deal with the hygiene issues and especially the drug stuff."
Which isn't breaking up with him / ending it... it's just telling him you want more than he's giving you now.
You don't know what to do? Even though all of the above is true and he's now called you a cunt and a shit mum?
I'll tell you what to do.
Stop thinking about yourself and your sadness because at the moment it's doing no good. Think about your daughter and about the example you're setting her if you don't absolutely cut this man off today by blocking him.
Or do you want her in 20 years to be with someone who does all of the above and then calls her a cunt and a shit mum?
You've made incredibly bad decisions to do with this man before (staying with him despite his flaws and him cheating multiple times) and I'm afraid "but I love the bugger" isn't really good enough when you're a mum.
He's called you a shit mum. Show him you're not by telling him no more contact, his stuff is outside the door but you won't be speaking further and will be blocking him and that any calls etc will now be treated as harassment.
Seriously, put your daughter first FFS.