Moll just catching up with you after returning from holiday. Reading the stuff that's happened in the last week I was hoping you wouldn't meet up with him for a drink, was not surprised that you did and not surprised how you felt so low afterwards, the man is an emotional vampire for you, he sucks the life energy from you. Not wishing to sound over dramatic about it but I think there's something to that. H is so incapable of reasonable emotional responses and reactions, he has got them from you in the past. First the arrival of dd and now you leaving means that there is a huge void in his life. It's not you he wants, it's your energy, he needs to suck that from you b/c he doesn't have that inside himself or doesn't have a way to access it. So sorry to say I don't think it's that he wants YOU and dd back, it's that he needs his emotional fix - that's what you bring him.
Then I saw that you refused to meet with him again - hoorah! Then that you agreed to speak on the phone, my heart sank. I think that was a mistake, you got sucked back in again.
I think the joint holiday would be a mistake. I think it would be miserable and I think it would solve nothing.
I don't know about H being a physical danger to dd. I remain concerned about him being a physical danger to you. I know he didn't hurt you physically when you were together. He didn't need to. He could control you without the need for that. Now he has lost control of you and his best efforts are not working. So where does he go from here? I don't know but as his options narrow, he may lash out and I don't want you near him when that happens. Please continue to protect yourself.
I think it can be a real problem when you are warned that he's potentially dangerous b/c it means that you look to protect yourself and one way to do that is by not provoking him. Which means you're still in that abuse dynamic, I hope your IC has something helpful to say about that when she returns.
I also agree not to get sucked into email correspondence. It would be best to just have your standard response so that eventually he recognises that's all he gets from you. Sure it's tempting to tell him you gave the flowers away but in the long run I do think it's best not to respond.
My SIL is currently going through a nasty divorce from a very abusive man, very much like your H. She left when her dd was 3 weeks old, that was over 2 years ago now. They're still not divorced b/c he's defending it - the whole thing is ghastly but the reason I wanted to mention it to you was b/c when she first left she met up with him, he guilted her into sex several times, she would listen to him for hours on the phone despite us all trying to encourage her not to pick up the phone, to change her number, email address etc. Now he's using all that against her saying it's clear the marriage isn't over. I don't want you to go down that road....
You're getting great support IRL from your family (especially your mum, she sounds great!) and your IC. Lean on them when you need them. It took a long time for you to get deeply into this abusive relationship, it will take you a long time to recover from it. Don't expect miracles from yourself, you're doing the best you can.
I think for me one of the reasons I managed to avoid looking at my abusive relationship was b/c I knew it would say a lot about me if I looked at it. And maybe that's the bit I didn't want to look at. It meant acknowledging that the person I thought I was (strong, independent, capable) maybe wasn't all there was - there were some very vulnerable parts to me that allowed me to stay in that relationship. Facing those parts of me has been tough - but necessary.
You continue to do so well, keep hanging tough Moll...