I guess it's like anything where the "better" people despise you for being inadequate - I tend to wonder why, if they're so much better, they don't have any spare mental capacity for kindness, empathy, compassion or humility.
Perhaps I'm too systematic in my approach to being nice, kind and compassionate, and reliable and dependable - but I refuse to be bitchy about others behind their backs, I refuse to change plans on a whim just to deliberately assert control over a situation in a way that makes it difficult for others, I stick to rules that make sense for the greater good (and quietly say nothing and ignore ones that are just silly). The NTs in my family all seem to spend their lives being bitchy, nasty, whimsical, selfish and unreliable - but they all despise me, think I'm humourless and unimaginative and a social weight around their necks.
My NT sister and BIL spend a lot of time rubbing my and my father's (ASD) noses in the fact that I and my father have embarrassed DSIS since I was born, and their child is SO MUCH better than me/DF IN SO MANY WAYS because their child is neurotypical. "D"SIS seems to resent everything I've ever done in my life, and gets together to recount stories of how my father and I are embarrassing and inadequate, with "D"BIL and our mother (who incidentally clearly also has ASD but lacks social insight to a point that she doesn't really see what she's being led into).
When I get together with my aspie academic friends - we don't spend the time bitching about our selfish, unreliable relatives - we talk about interesting ideas and stuff.
AIBU to get a bit depressed at being thought of as an embarrassment and a liability?