I wish i could give both of you a hug, and the baby.
Its bloody difficult and its a major time fo change for both of you.
Lots of stress , when a new baby arrives.
I think small steps are needed here.
simply carry on feeding the baby, in a matter of fact way.
On rare occasions when baby is down for a nap, keep a little phsyical contact with partner. hold hands. Look directly at his face when you talk to him.
Tell him you were glad he was with you when you had the baby.
that no one else would have helped you ,and that it was important that he was there.
You may think he knows this, but sometimes we all need to hear the good stuff.
I wouldnt worry so much about him not appearing to love the baby, its all indivudual, and quite frankly happens to mothers all the time, so why not fathers?
I didnt love my first until he was about 3 days old. I thought he was ugly , horrible and kept thinking his mother needed to take him home!!! ( and I was breastfeeding him as well!! LOL)