Hi OP.
I'm not sure how much comfort this will bring you, as I'll be honest in saying that it's been a rough few years, but on the off-chance that it does, here goes:
DC1 conceived within 3 cycles (aged 25). Now, I hadn't it officially been diagnosed at this stage but historically had always had horrendous periods so I'm going to assume that it was already there.
Started TTC DC2 4 years later. Nothing was happening and proper investigations began - note these were related to my inability to conceive, I still had no idea of underlying cause at this stage.
Finally diagnosis with stage 4 endometriosis. Chocolate ovary on one cyst, POD covered, bowels stuck in places. Both tubes completely ruined by scar tissue.
I went through 2 cycles of IVF and one natural pregnancy - all miscarried unfortunately. There were also 2 x laparoscopies during this time.
It was eventually discovered that one tube was full of fluid (hydrosalpinx).
During my most recent laparoscopy this tube was removed as there had been a chance it was leaking onto (and subsequently destroying) any embryos.
We began one final cycle of IVF which was a complete non-starter as my eggs weren't responding to the stimulation.
We gave up and moved on.
Then, you guessed it, I conceived naturally 6 months later. DC2 was born last year.
I'd imagine there was some degree of the age-old 'it'll happen when you stop trying' shite that gets trotted out to people desperate to conceive but unfortunately there's no 'stop trying' switch when it's all you want!
But here I am, two children later. It can happen 
Good luck to you 