We live in a quiet cul de sac, mostly retired people and families with young children. Newish neighbours are having extremely loud party in their garage & front garden, spilling over on to the street. Lots of very loud people wandering around on the roads, drinking, smoking, sitting on other people's walls etc. The noise is considerable even with our windows all closed (we are opposite). No music, mostly people shouting, screaming and occasionally fighting. I would estimate around 30-40 people roughly, maybe more. They sound a bit like a crowd of football hooligans. 
DH hates any kind of noise at night, and is furious. DD's room faces on to the street and she can't get back to sleep. I thought it was dying down earlier, but it's getting worse again. DH wants to call the police now, but I thought that was a bit heavy handed. Now I'm beginning to wonder.
Until what time do you think we should tolerate this? Oh, and please don't tell me to go over and ask them to shut up, as they look really intimidating. They did see me closing the upstairs windows, and seemed to find it highly amusing...