On the practical side of things, they will not change your due date after a 20 week scan...the 12/13 week one is now used throughout the pregnancy.
Up to about 14 weeks babies grow pretty uniformly but after 14 weeks the maternal environment and the babies own genetics mean that they start to grow at different rates, so dating them after this point is considered inaccurate. This is why they want to do the dating scan before 14 weeks.
IME, I would suggest that your scan dates are likely to be a lot more accurate than your LMP dates in this case because:
a) the seven week and 12 week scan were consistent with each other and
b) there is a huge change in the appearance of the scan between 6 and 7 weeks- at 6 weeks there is basically just a round or kidney shaped thing with a pulsing heart beat in the middle, at 7 weeks it has started to elongate and limb buds are present.
Just looking at all my different 6 and 7 week pictures now, they look completely different. So for the 6 week scan to date you at 7 weeks, would not just be about the size of the baby, but also the appearance having changed into what things look like at 7 weeks, if that makes sense.
I would place less emphasis on the pregnancy test showing 3+ and your symptoms (although they do suggest the dating scans are right) because in my experience these things can and do vary between women.
The issue of the day 8 conception is also not unlikely, I think. I ovulate on day 14 almost every cycle. I am currently in my 6th pregnancy, and in one of my PG's I got pregnant on day 7 and in another on day 21, so I can't count on not getting pregnant early or late in a cycle, if that makes sense.
I know this is not the answer you were hoping for, but I think it is impossible to be certain that the baby is your bf, and is more likely to be the other man's by dates. Sorry.
{As someone else suggested upthread, possibly this is just one of those things, but also possibly if you were very fertile and your bf not, then falling pregnant more easily with another man might be suggestive of a problem with your bf fertility, or might just be a complete fluke}
I am 22 weeks pregnant and know the hormones and emotions are a lot to deal with about now, without your additional worries. It must be very hard for you. Do you have anyone in real life you could confide in?