I'm sorry you're going through this stressful time. like everyone here, i cant possibly comment about your ds, but to give another perespective: when ds had his assessment when he was 3.6 we were "offered" the dx of asd, as the team felt he was 'borderline'. Assessment and diagnosis isn't always a black and white thing, even though the ADOS is a numbers-based questionnaire. We took the diagnosis, as we knew that he would be the same child with or without it, and knew that the 'label' might actually be helpful in the future. As someone has said, it isn't the dx/label that gives your child asd, it's the asd that does that. What mattered far more to us was, and is, recognising his individual difficulties and addressing those, and we had startled ABA therapy before he was actually diagnosed.
In the US there is the PDD-nos (pervasive development disorder not otherwise specified) diagnosis which isn't used here, but is more of a catch-all for communication/developmental disorders, and i suspect my ds wouldbe been diagnosed with that if we were in the states. I also wonder one day if the generic asd umbrella term will be broken down into much more specific and discrete conditions one day.
Fwiw ds is now 7yo and can seem so near NT that we now have the situation where we struggle getting school, and even family, friends etc to remember and recognise the difficulties that we see. If assessed now he might not be given a diagnosis of asd, but I am 100% certain he has it, and am glad he got the dx when he was younger.
I also knew a family whose ds was showing clear signs to me at the age of 4 or so, but he was assessed and categorised as not having it. The mum was jubilant about it, as if scoring 49/100 (no dx) as opposed to 50/100 (dx) meant he was just fine. His lack of dx didn't stop him having huge difficulties, and they are really struggling now to get him support without that 'label'.