My sister and I are wracking our brains!
British woman author. The man in the book is a teacher, abused as a child and knows he is attracted to boys but fights it. Then on a trip a girl accuses him of abuse. He is innocent but confesses to his wife that he has this desire. She leaves him.
Probably 10 or more years ago?