Ok, you have given him a choice to have sex with a woman who wants sex with him. For some reason he chooses to have sex with an unwilling woman (you) what sort of man is he in this case? Is he a man you want a relationship with?
If sex has always been out of the equation, unless it's coerced, unless he nags and makes you feel guilty and worn down, what does this say about him? He's either a misogynist bully, or a deviant who likes begging!
Or, you didn't spell it out to him that you didn't want sex, had a sufficient amount of sex to give the impression of being willing and he's just an ordinary man wanting intimacy and sex with the woman loves. So I'll ask again, did you have sex or allow him to think you willingly had sex when you met him?
You don't have to tell me, but think about it and be honest with yourself. Either you have put yourself in this situation or not. And actually, no man has a right to sex, and every woman has a right not to have sex she doesn't want. I'm not very concerned about his feelings, I'm trying to help you.