I think it depends on the neighbours. Our unofficial quiet time here is midnight to 9am all week long.
I know children don't stay children forever, but it's still a bit like whether you buy next to a church should dictate whether it's acceptable to hear bells.
If you move into a very kid friendly/unfriendly neighbourhood, you should expect to adapt to that noise profile. I think it's ridiculous to assume everyone's sleeping patterns are the same as yours, and you shouldn't intentionally piss off people because you're entitled to do so. You need to get a sense of what sort of hours the people around you keep, and all make a few compromises.
It's just nicer when neighbours take each other into consideration.