I get this.
I've got a small group of friends that I go to a burlesque type immersive dinner event that is run a couple of times a year locally.
it's nice to get dressed up and have a few cocktails and have a dance.
although the first time I went, I had two cocktails and I don't know what was in them, but we were all absolutely wasted and the day after was a write off!!! 2 of the others were sick, and I got off lucky with a headache and feeling wiped out - but it wasn't the kind of hangover I would happily repeat!
we've been back since, and people have been more sensible (although two cocktails wasn't particularly wild!!) as it's just too hard to parent the following day, take the kids to parties, do chores etc.
so yeah it does feel a little bit like we're always saying "ooh I'm not going to drink much" or "I need to leave by X, I've got a kids party at 9am" because mum life doesn't stop!
also, it's really hard to get these dates in the diary as everyone is so busy!
I've got another group of friends from uni who try to get us all together occasionally. Where we all live a fair distance apart, it involves more lengthy travel and an overnight stay, so we often get an air b&b or something.
on previous occasions where 2 or 3 of us will arrive as early as possible (late morning/lunchtime) to make a day of it, before dinner out and our overnight stay, one of the others will be sure to double book herself, turn up shortly before dinner, and then have to leave at the crack of dawn because she's got dinner plans with in laws. Feels frustrating that friends can't commit to plans and make it worthwhile, when we're all spending money to travel and stay over. But I've just learnt that we all have different priorities.
if your work friends are the fun ones, embrace that! And keep your other friends for coffee dates and supportive chats.