No judgement from me either, OP.
You say that, "You just wanted to know that you could have him". Well, you did, didn't you? You 'tempted' him away and he wanted to be tempted by you. So what's left to do? You've done it all.
What I'm saying is that the challenge is over, you have successfully engaged in an affair with a married man, albeit the same one. He could have ended his relationship and not got married again - you could have ended your marriage - and you both could have been together. It wasn't right for either of you then and it isn't now.
Your husband has stuck by you, he knows what you did and believe me, he will have had to swallow that damage for a long time. If you think about the well-meaning but very difficult to hear advice from posters whose husbands have been cheating - that they should LTB and that it will never be the same again and she would never be able to trust him again - well you can see that the same would have been true for your husband. How much he must absolutely love you to go through that pain in the hope and faith that there is love from you and a point going on with the marriage.
If you really cannot see yourself ending things with OM once and for all then please, end your marriage. Do it decently and kindly and make sure that any relationships you have after that have some sort of reasonable interval so that you husband doesn't completely think that he was nothing at all to you.
I wish you well, you're treading a very lonely and tortuous path and it's going to bring you nothing but pain in the long term. The glimpses of 'happiness' that you feel in the company of OM will be extinguished once you realise what they've actually cost you... and that realisation will truly make you weep.
Really think about what you're doing and be absolutely sure that it's right for you because regret is a horrendous thing to have to live with.