to expect DS's dad

[ISwearImNotATramp]

To be the one to drop him home? Not his mum or sisters?

DS is still a small baby and he only has him for a couple of hours at a time. AIBU to not want to deal with his family when I've left DS in his care?

I don't see the problem with him asking a family member to drop him off.

If your problem is not wanting to have to communicate with the family member the other end, could you send a contact diary between the two of you where he fills out the information you need ie. feeds, sleep and you can read it.