The things I'm avoiding are the things that can cross the placenta and damage the baby. So that means:
Toxoplasmosis: I am avoiding rare meat. I am eating cured meat though as the risk is much much lower.
Listeria: I am avoiding unpasteurised soft cheese, and all mould ripened cheese whether pasteurised or not. Unpasteurised hard cheese is ok, conversely pasteurised mould cheeses (eg pasteurised Brie or chevre) are not ok. It's all to do with when listeria is most likely to grow. Also avoiding pate and buffet salads as those carry quite high listeria risk.
Sushi: I'm not sure whether the parasites in raw fish can cross the placenta, but am avoiding anyway since I'm not too bothered about sushi.
Alcohol: limited, maybe 1 unit a week since second trimester.
Caffeine: limited eg 1 coffee or 2 teas a day.
Eggs: I am eating runny eggs since 1) they are lion stamped so barely any risk of salmonella and 2) salmonella doesn't cross the placenta.
Liver: I am avoiding in anything other than minute quantities.
Seafood: I am eating. Yum.
Everyone must make up their own mind on the risks they are willing to take but it's sensible to understand why things are risky before you do that.