I'm not sure - either it's the school of the infants (so apostrophe), or it's an "infants school", so the infants part is an adjective rather than a noun.
Gut feeling is that "infants' " is wrong, but am not sure.
Thankfully not a school I have any dealings with, but annoying I have to drive past it at least twice a week.