I agree with your point that where money is available it should be targeted at those that need the most support, rather than spread too thinly.
For context I am diagnosed as Autistic and ADHD, I am absolutely one of the people who has found my own coping strategies, I have a full time job, I don't get any support, and I don't think that any of the scarce resources should come to me.
However I am significantly impacted by the differences in the way that my brain works. I use unhealthy options (alcohol and unprescribed drugs) to self medicate. I break myself over and over trying to fit the norms of society. The extra effort that it takes me to meet the standards of my employment (e.g writing long scripts the night before meetings, and regularly working from 0800-midnight, for the reason that I am expected to be at my desk 0900-1800, but I can only start to get work done when I'm not being distracted by emails, meetings, comms. All of this happens quietly, hidden away, without bothering anyone else, and it severely impacts the time I can spend with my family and my health.
Over the past few years I tentatively started to come out of the closet as neurodivergent and have met all sorts of kick back from people who see my full-time job as evidence that I'm making up my differences, or that I am looking for 'attention' (I never want attention, I hate attention).
So save the term 'neurodiverse/neurodivergent' for people who are 'well away from the average', what do I call myself? How do me and people like me even being to try to explain our situation?