Expecting a teacher to pick up a pupil alone even in the pouring rain is unreasonable. Abuse is no more common now than in recent history, we are just more aware of it, and anyone taking precautions isn't being over cautious, they are being sensible.
That may be true but it's not unreasonable. It's nuts.
I'm cautious. But if someone my child knew and trusted, deliberately drove past in the pouring rain, or in a situation that was more risky - like darkness, alone in a lonely spot, not much chance of a bus - I'd be disappointed to say the least.
I wouldn't say anything, because given the number of people on this thread who think that a man being alone with a child puts the man at risk of the child falsely accusing sexual abuse, I'd be on a hiding to nothing.
But I would judge you for leaving my child in a dangerous situation or even just a bloody miserable one. Or me, for that matter.
God knows, my main priority when offered lifts in the pouring rain by people I know is to get in and immediately make up a complaint of sexual assault. Though sometimes I wait until I get into my comfy jim jams 
Even given the remote possibility that all us mad women and children are gagging to make false allegations of sexual assault about innocent men, there is such a thing as medical evidence.
In the case of inappropriate words or touching, the police are very unlikely to act. So your husbands are safe there.