That's an interesting point.
Throw it the other way. Should I have to sit each lunch time with someone I actively dislike and who irritates me, if they are "popular and beautiful", or am I ok to to have my boundary encroached every day because my discomfort doesn't matter as long as I'm inclusive. Or should I be able to say, no, I don't want to have lunch with you. And they can accept that, being "popular and beautiful"
Now what if this very irritating person is in a wheelchair. Do I have to allow them to irritate me, and encroach on my lunch every day, because if I don't, I'm not inclusive and now disablist to boot.
The fact is, you can be a lovely person with dsylexia, or a horrible person with dsylexia. A lovely person with ADHD, or a right git with ADHD. What's not ok, is not being able to say, "hey, that's horrible, I don't want to be your friend" to NT people, but not to Non NT. As I tell my son frequently, ADHD is not a get out of jail free card. Sometimes, you are not responsible for your actions, but for plenty of the time, you are.
My DS is wonderful. And frequently very irritating and repetitive. It's all part of his ADHD. If he'd decided to focus on one group of his peers, every day, knowing how intense he can be, when all they want to do is eat their lunch with their friends. Am I correct in the understanding that I should be up in arms about this nasty isolation when they tell him they want lunch in peace? That is not preparing him for the real world. Like it or not, that's how it is.
If another boy followed my DS around every lunch, not taking the hint, until my DS said, "no more!" I would be happy that DS stated his boundary. It's not the children's duty to placate this boy, or be deemed mean and non inclusive if they don't. SEN or not.
I can be precious about it, under the guise of a protective mother, and force an unnatural dynamic to exist, for his school years perhaps. Or, I can throw my energy into helping him grow better coping strategies, to become resilient, to focus on what he can achieve, and to ignore those who aren't his friends.
I spent enough time being the first type of mother. I had my time again, I wouldn't have made that mistake, but at least I've recognised it now and things are already moving in the right direction.