Why is it sexist? It is used to refer to men too.
Why is it belittling? It conveys a sense of someone with loads of energy who loves going to the gym.
Why would it stop anyone going to the gym? It's a term that refers to a person who goes to the gym a lot, that's it. Sounds like you are reading a lot into it which isn't actually there for mots people.