I think your doctor is mad, personally.
I've been in unprotected sex for over a year now, TTC full time for 9 months. If I had to not take pills "in case I was pregnant", I would be in a very sad state of affairs
My doctor, on the other hand (in fact, even the pharmacist I saw yesterday), waved off my TTC efforts by saying "are you pregnant", I shrugged and said I was in limbo land and he bascially said that its not worth bothering with until you get that little strip on your pregnancy test.
I appreciate that you want to change whole lifestyle when all you're doing is upping your sex, but just be cautious when giving out information to other people who aren't in the know.
Even drinking alcohol has no bearing on your fertility. They are just trying to ensure that you're not drinking while pregnant. Drinking while TTC may have an effect on DH's sperm, but at fairly large doses. If he is sporty at the same time, he can almost counter balance the damage done. Unless it's cycling - at which case, if he is doing HUGE distances, it MAY slow the swimmers down, but every pro cyclist I know has kids so it's got to be taken with a pinch of salt.
Since I've been TTC for quite a while now, and whether I've been fit or not, active or not, healthy or not, in pain or not, immigrating or not, stressed or not, on vitamins or not, on EPO or not during that year, I can honestly say that me taking an antihistamine to stop me drinking 6L of water (which by itself has created cramps in my body because I've flushed out all my minerals) at night so that I can sleep for one night will NOT be looking down upon by any medical professional simply because I am only upping the number of times a week that I have sex. I do not have a baby inside me. I even have a foetus inside me. And even if I did, I have 6 weeks of having that feotus inside me before I need to really watch what I eat or drink or what I expose it to.
So please be cautious about trying to warn people off certain things. Even if your doctor told you that, it doesn't mean that my doctor would tell me the same. Your medical advice is personal to you. Not to me. :)