Do not cave OP.
Picture him in that strip club laughing and leering.
Picture his face when he turned off the wifi to goad you.
Picture his pretend sad face playing the woe is me card to his mum and sister a few days after he paid other people's mums and sisters to get their tits out by dropping pound coins in a pint glass.
Picture him smirking (as I'm sure he did, they all do) in response to reasonable questions from you, as he couldn't believe the audacity of being challenged.
Picture him withdrawing / transferring the money from your joint savings as soon as he left.
Picture your daughters being in a relationship like this as adults and you wondering if it's because they saw you take him back.
Picture your sons behaving like their dad in future relationships and you wondering, disgusted with them, if it's because they saw you take him back.
He is an absolute cunt, a bully and smug as fuck. If you take him back, you are telling him point blank that you are someone he is entitled to trample over, bully, treat like shit, demean and drain the joy out of.
He's a fucking dementor mate, summon your patronus and zap him.
Imagine the Mumsnet army is standing with you.