He's at work enough already! Long hours, contactable 24/7 thanks to lovely modern technology.
I think its selfish of his work to expect everyone to attend a work jolly that involves 2 days and an overnight stay - its over the weekend too.
I'm not going to stop him going, he's looking forward to it.
Am I being unreasonable to be annoyed about this?