If you were getting pleasantly pissed in the garden with your friend but ran out of booze, would your DH/DP nip to the corner shop for more wine and some snacks for you?
They aren’t part of the socialising as such - perfectly welcome to join in but see it as you socialising with a friend.
YABU - he wouldn’t go
YANBU - he would go