It's always said in a smug or martyrish way. For example, at work earlier: colleague A "last week was tough, I was here late every day because of X project", colleague B: "ha, welcome to my world".
Argh! Yes because working late is your thing, you're the only one who has ever worked late.
I find it more annoying than the bastard love child of "I'll send you an invite" and "would/should of".
AIBU?