He can't just shake it off like most people would. I think he hates injustice. I can see him internally stamping his foot and saying it's not fair
I agree, but on the other hand I think it's very easy for viewers to underestimate how it feels to be cooped up with all those people, not of your own choosing, in a house that's being filmed 24/7.