OP, I'm sorry, he's a shit. He's a shit husband, and will be a shit to you too. In fact he already has been, because if he wasn't, he never would have drawn you in like that.
The hard truth is, if he's not leaving his wife, he still loves her. He's likely attracted to you, but it's not love, and you certainly won't have his loyalty. You are providing an enjoyable diversion, ego boost and attention. I'd be willing to bet he's done this before.
As a former family therapist, I can tell you without hesitation that when a man gets caught, the full weight of the possible consequences will hit him hard. Selling the family home. Not seeing the kids every day. Dealing with the kids being upset or acting out. Splitting assets and reduced standard of living. Legal fees. Paying child support. Possibly losing friends, as well as totally nuking your relationship with your inlaws. Most men will fight tooth and nail to save their marriage, even when they are no longer in love with their wives. Because their marriage isn't just him and her, it's their family, it's their entire life. An affair partner is rarely ever more than a walk on part, no matter what the married person says. He will drop you and block you in a heartbeat if his wife finds out, and he will probably blame you too, to save his own skin. He will have absolutely zero loyalty to you, or care for you, if he is compromised.
If you don't believe me about the married man script and want to know how married men who have affairs think, go on r/adultery on reddit, or r/theotherwoman. It's sobering reading that I recommend to anyone contemplating an affair, because it's a nasty reality check. These men have affairs for years on end, declare love, but turn off like a light switch when they get caught. And they don't protect the affair partner from the wrath of the wife either, often resulting in public embarrassment, ruined careers, lost friendships, etc. Blaming the other woman is a convenient way to never have to look at themselves, or make hard, adult decisions about not being happy in their marriage any more and taking responsibility for that.
Affairs destroy everyone involved and it's not worth it. Walk away now for your own sake. You can recover from a 2 month dalliance, but the further you go in, the harder it will be to extricate yourself, and the more it will hurt when he inevitably chooses his wife and family. Your job is to choose yourself, because he won't.