My XH said the same thing about DD who was 4yo when he left. He left me, not her. I said he had left her, it's a simple fact! He does see her EOW but has always put OW first, drops DD to go to concerts, or OW's birthday, or holiday with her, but won't have DD at all in the school holidays apart from a few days after Christmas.
I get all the self pity too, about how hard he works and hasn't got any money and can't take any time off (except when it suits him). I tell him that I am working full time and bringing up his child on my own. Then I just get abuse from him because I am being unreasonable apparently....
Now XH is moving away and wants to see DD less but I have asked him to continue with EOW and that apparently makes me unhelpful and inflexible
.
So basically, he would like to move away and see her when he decides that he has time, which would be rarely.
It is very difficult to detach, but you can't make him have a relationship with his DC. It is something that I really struggle with as I want DD to have a relationship with him, but I can't make him do it :(
You are right in that they are running away from things, but sadly they take the person that they are with them, there is no getting away from that.