Yes, it is a bit early in the morning, isn't it, sobernow! can't cover all the points here but, I was thinking of my own experience of school.
I became increasingly shy and withdrawn as school progressed. I was OK in primary school, a little shy, very in awe of the teachers, but when I went to secondary I was bullied a lot, withdrew, hardly spoke a word all day but studied like mad. My education from age 11 had lots of negatives. The teachers took pity on me and put me in for the 13+, which I passed. But even when I changed schools I never got my confidence back (the bullying was the only reason for this, but it was one of them) I was painfully shy, wouldn't go on school holidays, or think about doing most of the extra curricular stuff on offer. It took me years to shake off my shyness.
Anyway, one of the wonders of motherhood for me is seeing how different my sons are to me. How they approach things, how they don't get on or do get on with people, what they like to do. I can't really speak of my 4 year old, it is too early to know, but with my 9 year old, I know his experience of schooling will be nothing like mine because he is such a different 9 year old to the one I was. I mean the teachers tried to encourage me to come out of my shell. In my son's case they try to put him back in it a little
So in my case, my decisions on his schooling have to relate to him and the here and now. I can't use my experience as a reference point.
Anais, you sound as if you feel your son is much more like you - the aspergers etc. Do you think this helps determine your views on his education? I know he is very young, so difficult to say. But as he grows older, if he seems very different in outlook and temperment, will you still feel a school is not a good place for him because of your own experience?
Having said this, I've read details of your days with your son, and I can't see how he would be anything less than happy, learning and stimulated. So I guess if he continues to thrive at home, and likes being at home, then does it really matter if past events have coloured your attitude to his schooling? I don't know the answer to this, frankly.