OP I have had a friend go through this. The whole reason she embarked on it was because of abject misery at home. With the wrong guy. Neither of them were horrible they were just wrong for each other. Split up eventually but not until she realised that the EA satisfied nothing in real life.
Your posts, particularly the last one, sounded incredibly contradictory. Either you want him to leave his wife for you or you don't and you are content to carry on in this fantasy world for the rest of your days.
I'd say deep down you want him to leave and set up shop with you and all will be hunky dory. I am afraid that if that happened you'd be doomed to failure and end up in another affair with someone else. You haven't even slept with him yet he could be shit in bed for all you know! (you know you are going to get physical with this guy don't you at this rate?). He has kids. So you're going to have to make friends with them once the two of you are shacked up - how is that going to go down with them as the woman who spilt up their mum and dad and caused so much pain? That is reality, not some meaningless bullshit on a text message.
An ea is an affair I don't care if it involves any touchy feely or not. You are currently cheating on you partner - being married has nothing to do with it.
The reality of this is not pretty. It won't be if he leaves and moves in with you. You have nothing of substance with this man.
So your partner might be a pain, why don't you just ditch him then if he's such dead weight?
You know as well right if this married man can cheat on his wife he is more than capable of doing it to you?
You don't deserve a flaming for posting and wanting to know about others and their opinions. I feel quite sorry for you as there is a hint of desperation in your messages. There is not one person in the universe, me included, who has not at some point in their lives caused deep and painful hurt to another, intentional or not. It's just this particular topic has hurt them and it's not easy reading.
But you sound seriously messed up and confused and I think you should get some form of counselling to talk through your priorities. Your issues I think go deeper than a crap relationship and enjoying a fling.
This is not normal behaviour and the world you inhabit in your head with this man is not real - just remember that.
I hope you find a resolution.