Teddy has been very reasoned in his response, but he's not whiter than white is he? He clearly was attracted to Clarisse, and whilst he didn't fully act on it, his response to her when she asked him to share his bed etc didn't exactly shut her down. We don't see every part of their day, but it seems like he made no mention of that when he came back, but he's an intelligent guy, should he not have thought it was coming back to bite him in the arse at some point? You're on reality TV, nothing stays secret for long!
If he felt he couldn't tell Faye because he was worried about her reaction or whatever, that's not a good sign - and in any event was clearly only delaying the inevitable.
I'm not on board with all this 'poor Teddy' spiel. People are siding with him because he was calm and didn't argue back. But you could say part of that was because he realised he is partly in the wrong and being honest sooner might have resulted in a less explosive outcome? Who knows? I suspect if he'd reacted to Faye and responded similarly everyone would be a lot more critical of his Casa Amor behaviour. As it is, it's easy to see it black and white that he's the wronged man.