My DH does this all the time. Not just to me but to our DC. I find it really annoying! I've told him this and he says that he's just explaining why he's reacted a certain way, or done whatever it is he's done. But I can't help but think if you're trying to justify whatever it is you've done then you're not really sorry...