I think that YABU
The Dutch rapist - horrifying but that's on the Netherlands selection committee
The Boxing debacle - awful but it's two individuals in one sport (that doesn't really deserve the name sport, it's sanctioned violence) and one the Olympics are trying to get rid of anyway, aren't they?
The caricatures - not sure. Most people, including most women, seem to have no problem with drag and even celebrate it. I don't like it personally but most people, in my experience, would not define it as misogynistic. Though I think probably most of mumsnet would.
On the other side, this is the first year that participation has reached 50/50 male female participation in the games. Women's events are given equal air time, equal reporting and qual hype. BBC has called the 'flagship events' as the Women's All Around Artistic Gymnastics Final and the Women's 100m. Not the men's finals. There are inspirational women all over the TV doing exceptional things and I think that's something to celebrate. I don't see hate.