DH has a group of friends from when he was a teenager (so 25 or so years ago). They're a decent enough lot. Over time they've all got married and moved around the country so now they only meet up 2-3 times a year, usually just the blokes and usually in their home town, some 250ish miles from where DH and I live.
There's been a suggestion of getting together later on in the year at an event that will mean all day drinking, uncomfortable clothes and shoes, gambling and small talk with people I don't have a relationship with, as well as sorting out overnight babysitting for DD. It's also not an event I'm interested in at all.
DH expressed interest in going to his mates before speaking to me. I've asked when they need to know by and when pressed, said that it doesn't really sound like my kind of thing. He's kicked off, saying that we never go anywhere dressy (this is the man that works in his boxers during the summer) and has been whatsapping them my responses verbatim. They're then coming back with suggestions to persuade me to go. 
I should point out that the last 3 times DH has gone out with them up there I've been woken at 3-4am with him paralytic and alone having been left behind by them - even when he's been staying at their houses, and he's then had to get to and sleep in his car or wake up a relative to sleep on their sofa at night.
So, AIBU to not fancy giving up a precious weekend to spend a day with these people somewhere I don't want to go anyway??