I wouldn't leave him over it, but bloody hell, how unfair. Why does he get the final say? AIBU to be very pissed off?