I cannot tell you what it is that made me unhappy with my sex, but I can tell you it was horrible hollow feeling to be surrounded by everyone happy for who they are and afraid to be open about it
The crucial thing you say here is that you were unhappy with your sex - that is your biological make-up as a man. Sex is not gender. Thus you are speaking as a transsexual, not a person who is arguing that they are trans because they do not fit sex-based social roles (gender) associated with being male or female or because they have an innate idea that they are the other gender, whatever that means. But even then, it would be helpful to know why exactly you were unhappy with your male body, which is what I presume you mean.
Also, and I mean no disrespect, but I tell my seven year old not to believe that everyone else has no problems or is quite happy, just that he does not know what struggles other people have and what outward face they are showing to the world. It is simply not true that everyone is happy for who they are! Otherwise, psychotherapists would be out of a job.
The second important thing you say is that you are an Aspie. My understanding and experience of Aspergers is that it lends a tendency to see things in very black and white clear cut categories, and I also understand there are concerns about the higher prevalence of people on the autistic spectrum who have issues around their 'gender identity'. In my opinion that is because 'gender identity' restricts rather than broadens options, so if someone on the autistic spectrum has issues with nuance, they will find it harder to fit into an ever restrictive idea of what being a man or woman is - whereas in reality, all that makes one a man is possession of a penis, how one lives or behaves as a man is completely individual and it is up to you to embrace, challenge or negotiate gendered stereotypes.
Of course, I cannot and would not say that 'trans' is not a valid identity, and I fully accept your own conclusions that you are happier being trans. I agree it gives you a different perspective on the world. But I do not think it gives you a female perspective (although I am clear you have not tried to argue this, aside from the fiction of 'real life experience' as a woman) and I do not think being unhappy with your sex and taking steps to address that makes you a woman either; it makes you a transwoman, and that is fine. There needs to be room for women and transwomen, and not crowding into the same space and co-opting the other's experiences. We should be free and safe to say this.
Truthmytruth - yes, what I wrote off the top of my head of what has happened to me is sadly the experiences of many, many women. Probably the majority. Yet to look at us, getting on with it, you would think we were quite happy with who we were and our lives. Where we have shown that we were and are not, over the decades, is with the feminist activism and legal challenges that have provided greater equality in the law, woman-centred maternity provision, domestic violence refuges, rape crisis centres, women's book festivals and forums, all places where we could seek support (from those who understood) to make sure that we were able to just get on with it. These are the things which transgender ideology undermines and erodes with the insistence that transwomen are women, and male-bodied people should have equal access to same-sex space.