sertraline while trying to conceive

[thrifttwig]

Hi I just really would like some advice on what to do!
I went on sertraline in July 2014 my DS was 10 months old due to anxiety and me generally being a horrible person to my husband. I really didn't want to go on tablets and did try cognitive therapy but didn't work for me. In October I tried weaning myself off tablets with advice of doctors (although I admit I did it far too quickly over the space of a week) it was horrible and made me feel a total failure. I knew that I would want to start ttc eventually and was so upset it wasn't successful. After speaking with my doctor she felt that it was generally safe to be pregnant and be on sertraline. I went away feeling relieved and not too upset to be back on tablets. I recently moved areas and have been thinking about ttc for past 3 months. Me and DH agreed so I went to new gp surgery to discuss and he was adamant that I should try to wean off as there are too many risks for baby. Even asked me "why wouldn't I want to minimise every possible risk" and "if it was my wife I'm your situation I wouldn't be very happy"
I really don't know what to do I have read up and seems like there are so many opinions.
I am worried about what it would do to baby but I'm also scared to start weaning off again.
Please can anyone let me know if they have been pregnant and taken sertraline or if they have weaned off successfully.
thanks