There's just something really horrible about it....rude and unnecessary.
It also smacks of someone trying to be smart and witty buy just trotting out a line they've been taught.
Equally irritating is "Did you mean to be so rude" because it's so overused and "This too shall pass." is also ANNOYING.
This too shall pass is actually a lovely saying but it's SO overused on here!