oH GOSH
we did quite a few times, it was only small breaks (less than a week), but never had any problems and were not worried at all about it.
I think as long as people are flexible and understanding there shouldn't be problems.
The first time was with 2 other families, we all had babies the same age and I was friends with the wives, though I only ever saw them at work.
We are not all similar, but being all intelligent peole there were never any problems, no one ever tried to impose their wishes onto anyone else, and we actually had a great time (even though it took us hours to leave the house each day). We took it in turns to cook and clean, and no one ever tried to get away with it na ddoing the chores in company meant they were not chores at all!! (I would never do a self catering holiday on our own actually!!)
We tend to have a similar break at least once a year, not always with the same people, whoever is free and happy to come and has children of a similar age.
DH and I are very laid back people, and someone would ahve to do something really nasty before they would ruin our holiday. In general we're just happy to be on holiday and will take things as they come, we go for the company mainly.
Good luck and enjoy your holiday!!