OP, I don't think you're expecting too much at all.
My DS (almost 19 now) excelled academically in most subjects, and wanted to abide by the rules so much he was really well behaved and did whatever was expected of him in the classroom (He has Apsergers). At lunchtime, no one played with him. It was like he was the invisible child.
He didn't have a statement, and neither primary or secondary did anything to encourage him to play with his peers, or his peers to include him.
He has anxiety and depression now, and struggles socially to the extent that when he's at college he's texting me in his breaks to ask how he should respond in general conversations.
Slightly different circumstances to your DS I know, but I would have loved it if at primary, there was more in place to include him socially, because life isn't all about how many GCSE's/A Levels/Degrees you get, it's also about growing up, friendships, relationships, having your heart broken, sharing secrets, having good and bad friendships and learning from them. It makes me so, so sad that so far my DS hasn't had any of that, because he is just the invisible kid that people don't even realise is there.
He goes to a LGBT youthclub which has helped, and I have friends whose kids he likes and gets on with, but while they're all going out to KoKo now til 3 in the morning, he's sitting in with me, and we get on so well, but I know it's not the same as being with his peers.
Sorry this is long. I hope your DS starts to be included, and soon.