The Sunday club runs are typically only 4 hours, maybe 5 with cafe stop. I'm confused when people say "all day" = 5 hrs.
It's not just the ride time you need to take into account, though.
It's the prep, the getting there/back, the coming back and cleaning the bike, unpacking/washing all the kit, having a shower and then them generally being so tired afterwards that they don't want to do anything else.
If a ride starts at 9am on a Sunday and takes five hours in total, that probably means they're out of the house 8am-3pm at a minimum. Then add on probably almost another hour of unpacking the car, showering etc. and it's now 4pm and the day is gone. What is there to do as a family at 4pm on a Sunday when you have young kids?
My DH cycles - it doesn't remotely bother me but then I'm not stuck at home dealing with small children all day as a result.
But his 4-5 hour rides are very time-consuming. It's getting all the gear ready, sorting out hydration drinks and taking snacks, sorting his bike, degreasing things and cleaning mud off and sorting laundry - adjusting brake pedals, packing/unpacking the car, having a shower etc etc. There's no denying that, as a hobby, it's very time-consuming and bloody expensive