Your smear test result was CIN III. That is not "invasive cancer", but cancer nontheless (called "cancer in-situ"). It would be highly unusual for colposcopy to find absolutely nothing wrong with your cervix.
Why did you gynecologist ask for a repeat smear test in six months if it was "non-cancerous"?
Without meaning to scare you, I will tell you two RL stories:
First is mine. I was diagnosed with "highly abnormal cells" in a smear test and then colposcopy confirmed this as CIN III. I had a small operation on the cervix, was pregnant within a year, and had no problems conceiving nor carrying to term. Gyne did not do a smear test during pregnancy. So that is the good story.
The bad story is a friend of mine, who neglected smear tests for a couple of years, and then went on to have a baby. At her 6 week checkup, doctor did a smear test which came back abnormal. Several operations later, the cancerous area was still not totally cleaned and they had to do a hysterectomy.
Doctors told her that pregnancy hormones make existing cancers grow much faster, and so smear tests are essential before getting pregnant. Apparently, this is why moles get bigger, and myomas (benign tumors) in the womb multiply during pregnancy.
All this to say that you need to contact your gyne at once. [Didn't you contact him when you got pregnant?]
Good luck!