I am suggesting there comes a point where moving aside causes unsafe conditions, Harridan.
How many lap swimmers can one pool safely accommodate along with recreational users before there are maybe ten lap swimmers using 70% of the space and everyone else is crammed into a small, unsafe area.
After an early swim on holiday I like to visit the pool to just float around, do a bit of reading at poolside, dip in occasionally to cool down. Trying to swim again when the pool is crowded would be massively inconsiderate of me. Other people have the right to just splash around, have fun with a ball, jump in, belly flop, whatever.
My usual 6am swim is not me on holiday btw. I live near a public pool. I buy a season pass. If I go on holiday where there is a pool then early might mean as soon as the pool is open - at any rate before other people start arriving en masse. If there are swarms of people there as soon as it opens I don't try swimming.
I compromise! I still have fun! Everyone stays safe! I believe that as an adult it is important to model compromise and concern for the safety of others to children. I also believe it is my responsibility to ensure that I do not cause harm to anyone while in a shared resource. I do not expect children to carry this responsibility.
I don't know why some people on this thread believe that children having fun in a swimming pool should not be the default, and that the children should be the ones accommodating the adults. Swimming pools are built for fun and the occasional bit of swimming if conditions allow.
If there are no stated lap swim hours then it is safest to assume that all uses of the pool are considered equal, and lap swimming should not be tried if there are a good few other people there using the pool as they see fit.
Lap swimmers do not have the right to create hazardous or conditions in the water. Swimming as an activity does not confer any special rights to users of the pool. It does not trump any other use.