Ah oh course - you relaxed!!! Yes, that'll be it 

If only you'd thought to do that sooner! 
I might just nip across to the ttc thread and suggest that they all just need to relax.....
It amazes me when this comes from the mouths of doctors, especially fertility specialists
. Maybe there is a point early on in ttc (you know like within a few months) where you do more harm than good if you're stressing over everything. But surely if you get through the doors of the clinic then evidently 'relaxing' ain't gonna cut it.
Did you get / are you getting the results of the second SA? Would be interesting (although academic) to know if it had all worked?