Well its not as a universal fact, but isn't always for everyone. I honestly think the vast majority should try it if possible though, unless it is very obviously beyond them in some way (whether academically or just obviously something they would hate for some reason).
Luck and other factors also play a role. If you could go on the same "dream" holiday twice without memories of the other, one time could be plagued by bad luck, bad people, bad experiences, travel issue, lose things etc and that experiences will be horrific and "overhyped" just from that alone. The other time it could be the greatest experience of your life.
I also think you have to do a lot of research to try and match the best place to get the best chance. I wouldn’t have gone to a place that doesnt' offer guaranteed first year halls on campus with my first time, with a university with an actual campus. Visit to get a general "vibe" and things like that. Some people prefer and want a more real city living experience with a spread campus during this time, and there are universities like that.
Worst case, get your head down, complete your first year, get the most you can in general even if it looks like it isnt for you, and leave with a qualification that is still good - passing the first year of a course gives you a certificate of higher education. With merit for above 60%, and distinction above 70%. And from just an ok course, and ok university, this is looked on reasonably favourably above having only a levels in your field.