disey - read and had to reply!
I have had lengthy threads of here lately about my situation which is more or less the same as yours...
Around Christmas last year I bumped into someone I had a brief fling with (but huge feelings for) almost 20 years ago! At the time I was a teenager, he was a few years older, he was engaged with a small baby so although I was totally infatuated with him I did the right thing and let him alone. He did try and see me for a while after but gradually I met someone else and we lost contact. I was very upset about this for years and years as I felt he was 'the one' and so on but at the same time could never have got involved knowing he had a family.
Anyway, when I bumped into him a few months, he was single, but I am married (happily) with 2 DC's. We couldn't believe we had met again and he admitted he had been searching for me on and off for years but I had changed name/left the area etc. We got chatting, swapped number and got close again. Then...I got totally obsessed with him again. I couldn't believe that after all this time I could finally have him if I wanted him. But I also knew I wasn't prepared to leave my marriage.
So..after much heart break on both sides I knew I couldn't see him again. He started to change, alternating between being lovely and then really nasty. I have seriously been through hell these past few months BUT in a way I don't regret it because after 20 years I finally feel I am getting over him. He is not this great person I thought he was, he is not 'the one'. My DH is. Now he won't leave me alone though. 21 text messages the other night. Thing is, I never promised him anything, he knew my situation from the beginning.
So, I'm hurt, DH is hurt (and he doesn't know everything), this man is hurt. I wish I'd never gone there. Yes, it was great to meet up with him again, get to hear about what he'd been doing and his children etc, but we really should have left it there.....
I don't think you're being stupid as I know exactly how you feel, but I doubt things would be as good as you expect them to be..they certainly weren't for me.