Yep, holidaying as a single parent is hard work (I'm not actually a LP but my DH is disabled, so I do all the holidays). On the other hand, he would never have released the funds to go on holiday anyway, would he? Esp when he spends his whole life on holiday.
I only have one dc so the dynamic is a bit different but I pick holidays that I can enjoy (up to a point) so we often go to London and have a couple of days doing things there - mostly chosen by ds but I will lob in a trip round the Houses of Parliament or something that I want too. Short trips are the key, though, as Dolly says.