I wouldn't bother with trying to have a relationship with him.
However his responsibilities as a father are something else entirely.
Is your child maintenance arranged? You may be best to go through official channels in case he proves equally flaky and avoidant in paying that.
Same withh his access/time with his child ... It was his decision to move away from his child's mother and child donuts up to him to make the arrangements to see spend time with them and do some (minimal!) caring for them; whether that's by paying for accommodation (suitable for staying in with a baby) nearby during his visits, or perhaps you could vacate your home and stay with family/friend during his access. That would be more practical and keep baby in their home environment with all baby stuff convenient.
At the moment he's bearing no consequences for the child you've had together, and you are "on your knees".
Set that out, don't let him get say with it ant further, don't make him seeing and caring for his child dependant on/linked to seeing you or being in a relationship with you. It's far too easy for him to do what he's doing "we not "getting on", so I'm offski and you can do all the feeds, sleepless nights every night of the week while I go home to chill"
Separate the two.
I believe he still won't step up but it will be made abundantly clear to everyone that he's not doing so and you can record when he sees baby, for how long, what he does etc in black and white .. for both yourself/him and cm.apolication.