YANBU. I have two differently ND children and while they are not the most challenging I know, bloody hell my most of my friends with NT children have no fucking idea.
Yes I'm sure they have their struggles too but it's not the same. They are not stressing over their child perhaps struggling with living independently as an adult, or having zero friends, or not being able to grasp basic school learning, or spending days upon days trying to navigate complexities of SEN assessments, support, legalities etc etc etc.
We have the usual struggles ON TOP OF all this.
"In a different world perhaps it would always be a gift but with the way our society and world functions , it is definitely a hindrance on some occasions."
This sums it up very well. I love my kids and think they're brilliant, but the world is not set up for them, and that causes more problems than anything else.
The thing that's helped me most is having friends with ND children as well. They get it.