I was thinking about this yesterday.
IME when you have something that is different you can get quite angry about it, and have phases of being angry. In those phases, when people ask you about it, it feels instrusive and attacking. At the times when you are feeling more accepting of things, more comfortable in your own skin, then the same questions are taken as simply people being interested, and not meaning any harm.
To say that people should not notice differences, is to say that they should stop being human. We all notice everything quickly when we look at someone - sex, height, clothes, skin colour, hair colour, hairstyle etc and yes any obvious physical characteristices that are different to the norm.
The key is whether that noticing leads to nastiness/discrimination. If so, then it is wrong. If people are noticing, as is human to do, and asking, and not meaning any harm, then that is different. With a difference that is going to be life-long I'm afriad that my take is that it is easier to accept that people will stare, and they will ask, but 99% of them will not be feeling or thinking anything negative or malicious. Because people are not going to change, natural curiosity is not going to stop, and how you handle those people will affect how easily you come to terms with your difference.
IMO anyway. I understand the anger though, I have been there, but life is so much easier now I am not angry any more. It is not the fault of these people that I am different. And I do not mind them reminding me that I am different because I have come to peace with it. It took some decades to get there admittedly, but for me it is better.
I don't know if that is any help.