Yes, it's definitely baffling, I totally understand that. I think that if you understand the risks and are happy with them, then eat something.
It's people not being aware of the risks that is worrying - just because one person eats brie throughout pregnancy and is fine, doesn't mean everyone will be. In the same vein, one person's story of surviving an epic journey of hardships whilst pregnant (and having a healthy baby at the other end) isn't really helpful, because probably more than half of women who had to go through that would have had miscarriages. I wouldn't be happy at being told my risk of miscarriage was 50%! In the days before any guidelines at all (when there was also less skilled medical care available) far more babies and women died during pregnancy.
I always come back to: if you're happy with the risk:benefit ratio then eat or do whatever it is, whether it's goats cheese or antibiotics.
I love chevre goat's cheese, but find it easy to avoid (I have feta instead at home). So for me the benefits of eating it are minimal, therefore any risk at all makes for a poor risk-benefit ratio.
Eating fruit and salads on the other hand has definite benefits, so I'm happier to have some risk with eating that, because the risk-benefit ratio is still good IMO.
Not eating at all at an event (wedding, conference) has definite, immediate risks (I'll faint!). So the benefits of eating from a buffet in those circumstances are clear and I'd probably just try to avoid anything more risky (e.g. chicken or seafood dishes).
Lol at Chrissy83's tale - fwiw, peppermint tea also has some risks as it's a great smooth muscle relaxant (and the uterus is a smooth muscle!). You'd have to drink a lot of it, but it's ironic that you thought you were avoiding all risks in drinking it.
Life is risky. We gotta deal with that somehow.