I think the OW thing is possibly a red herring here, though not out of the question.
My own h has been obsessive for years, and is now tackling that finally really well, so I do have experience of living with someone like this.
If he is like this now, at the start of your marriage, I do think you are in trouble. My h, for example, was obsessed with work, sport, computer games, the computer generally, music, staying awake very late, and finally sex with ow via the net (in middle age). They are often obsessive about you at the start, which is confusing later on, but they just move on to another obsession once you settle down.
The problem with this sort of man is a basic underlying low self esteem , which may by the way be very well hidden by surface charm or sociability.They use their obsessions precisely in order to detach from their emotions, I think. If you hit a really difficult patch down the road, and we all do in our relationships, watch out, because they then tend to withdraw completely, and blame you. They are not at all keen on any kind of counselling, at least my h was't, suspicious of it, in fact.
Nobody can predict the future. But surely if things are this bad so early on, you are not going to have the life you deserve or need. I cant see it, anyway.
If the problem is already clear to you, and he is making it clear that he will not do anything about it, or TAKE YOUR NEEDS OR FEELINGS INTO ACCOUNT, then how is it going to get better, just because you ask for it to?
I dont see how anyone can live without intimacy. You are in a dilemma- you cant do without it in your life- who can, and he cant offer it. And because you are married, you cant fill the gap elsewhere.