You would be correct. Misogyny runs through the IOC like a stick of rock. They don't see the point of women's sport because men are better at everything, so why would you want to watch something inferior?
This attitude is very familiar to fans of women's sport.
I always say 1) men and women are different and you cannot compare two different machines directly. I didn't shrug at Usain Bolt's victories because my cat can run faster.
And 2) The mental aspect, the competition, the (insert that fantastic quote about sport laying bare the character like the bones in a skeleton) of it, is what makes sport watchable. The speed/distance/height etc doesn't matter nearly as much.