No, I think it’s partly that many of them know one another professionally and/or socially, and it makes them a bit more softly softly. As Alan said to Celia ‘You can’t keep giving people compliments and then voting to banish them!’
There’s also apparently a level of baked-in deference to people’s perceived status. It was interesting, for instance (I’m not British and have never watched the JR show for instance, though I know who he is) to see that JR knew what age Charlotte Church had been when she first got famous, and that Paloma had been a ghost train ghost, because he’d interviewed both. He helped create a lot of careers, presumably. And was visibly very relaxed under scrutiny, which disarmed people’s suspicions.
So I think there’s also that. Many of the people on the show are used to dealing with attention, positive and negative, and are less self-conscious under scrutiny. If you’re an actor used to auditions, disastrous table reads and rehearsals where you look like a fool and know everyone thinks you’re miscast, and dealing with stage fright, then you’re less likely to fall apart at the round table when someone accuses you of being a traitor.
All of which I think makes them faithfuls’ job harder.