Doha is right. If you really do want this man back, then you are going about it the wrong way.
First of all, really check your motives here. Are you sure you want him back for the right reasons, or do you want to win a competition between you and the OW? Don't be scared to admit that, because it is quite normal and understandable. However, it actually gets in the way of a mature decision. It could be, you see, that you will not be able to forgive this betrayal at all. It's not easy, believe me, even when a spouse deeply regrets an affair.
If you decide that you do want him back and want to start a path to forgiveness, the quickest way of doing that is to detach from your H. Do not speak about anything other than the DCs. He has no business knowing anything about your life and you should tell him so.
If you've got good childcare support, start getting out and catching up with friends. Change the house around and rid it of his influences. When he has the DCs, tell him you will be out, but not where you're going.
If this man is truly conflicted and having second thoughts, he needs an incentive to shit or get off the pot. The only incentive that works in this situation is loss and if he thinks he really has burnt his boats with you and wants to come back, he will do so much more quickly than he will, with your current strategy.
At the moment he is getting his ego propped up by two adoring women and that stinks, frankly.
I have to declare that in these situations, I would prefer a man like this to be dumped by both women and it would be my hope that in your efforts to pretend you've detached, it happens in reality and you will wake up one day and think "No man treats me like this" but I appreciate that for you, that day is far in the future.
Start being assertive and showing him that your life isn't on hold. This will actually do you the power of good, because I'm sure you never wanted to be like this, in a state of suspended animation and waiting for some idiot of a man to tire of his OW, did you?
Get your most assertive women friends on side and create a plan of action.