It really bugs me! Lots of conditions have spectrums so you could be talking about anything. It's so imprecise.
Also, I think it perpetuates the myth that there is one spectrum and everyone is on it somewhere so everyone is autistic to a greater or lesser extent.