How long does the kids "shouting" and "fence banging" go on for?
If it is over an hour every day especially at weekends or evenings when other people are in then their gardens then yes, that's very fucking annoying.
I had a year of balls being banged on my fence and over it (also did damage to the fence) and their kids SCREAMING at the top of the lungs I lost a whole summer as it was just constant sodding noise from sun up to sun down. So glad they buggered off.
You find yourself waiting for the next sodding ball bang or scream and shout and wind yourself up so you get more stressed and then give up and go back indoors because it seems like the parents of said kids don't give an arse about keeping their kids in check or care about anyone else being able to enjoy their outside space.
Take away the bloody ball. Your garden sounds too small for a ruddy football.
Get them a swingball, much more fun!!
Seriously!! I bloody LOVED swingball as a kid! You could REALLY whack the bugger and we spent hours trying to dodge that tennis ball on a spring at high speed!
Also..... A badminton set! OMG! So much fun!! NO damage (apart from the odd shuttlecock being banged over a fence) and no noise apart from laughter and fun noises from the kids. (plus you can do the "how many time can I keep it up in the air" games which I remember going on for hours as a kid)
And I love to hear kids having fun in their gardens, its so lovely hearing them giggle and be silly. Just when they get too loud or too wound up then tell them firmly to cut it out. That's your job as a parent.
Your husband is most probably wound up because he knows how loud and annoying your kids are being. Most neighbours are normally very polite until it gets to the point their can't handle the noise and balls any more.
Please don't let it get to the point your neighbours feel they have to say something.