I was told when I was about 19 that I needed glasses for seeing things far away (I can't remember what it's called!) I got them, but really struggled to get used to wearing them all & I didn't feel like they improved my vision at all, so I just stopped wearing them.
The next time I went back, before the optician had even started the examination, he bollocked me for not wearing them, he looked at my notes & said I should wear them all of the time & he could tell before the examination that my eyes were far worse already. He then looked at my eyes, did the examination & said that I needed to come back & see someone else.
When I went back about a week later, to see the next person, I was told I didn't need glasses anymore! My eyes had improved (although, I'm still wary that my eyes were ever really truly bad enough for glasses to begin with!) I've had my eyes checked every year since & they are still perfect 12 years later.
So I think sometimes wearing them all of the time can make eyes worse, obviously not for everyone, but I knew from the beginning, mine were not helping me.