no, you are not being unreasonable
check out this site
www.eatingforpregnancy.org.uk/default.asp?sID=1216033352415
so, no evidence that 1 or 2 units are harmful, after 3 months, although they recommend that you totally abstain.
if you know anything about public health policy they have blanket bans on as they assume people are to stupid to understand, and that it is safer for the majority.
in the same way that a lot of inner city health visitors demand that you give new borns vitamin drops to counter an increase in rickets, despite the fact that evidence pioints to the fact that rickets is a disease of poverty, and is compounded by having dark skin so you don't process the vitamins you require from sunlight. so, despite all this, well of white women are requested to give vitamin drops, as it easier and safer for the majority is everyone is told, not just those at risk
so, go on, have a glass of red wine. lowers the blood pressure, enjoyable, and one unit is safe.