No OP, your childhood experience isn't clouding your view. Your response to this endless assault is perfectly normal.
If you've ever had sex to shut him up - that's not consent
If you've ever had sex to avoid the inevitable consequence - that's not consent
If you've ever had sex that you said no to - that's not consent
If you've ever had sex you didn't fully consent to, then you have been raped.
If you're in the UK, the law is clear on this. If these have been some of your experiences then you are involved with a man who is predatory, dangerous and not what you thought he was.
I know people mean well when they suggest talking to him about this. He already knows on a daily basis this distresses you. He knows he's trying to push you into sex you don't want. He knows you're saying no but he ignores it.
He won't stop out of respect for the harm this does to you. He's an abuser, they enjoy hurting you more than they would ever enjoy loving you.
I say this on every one of these threads, so I'll say it again here. These men don't think like we do.
That's why we get blindsided, why it takes time for us to start questioning. They tie you in knots gaslighting you until somehow you think it's your fault or you're over reacting.
Reframe this through the lens that he hates you rather than loves you and it may make more sense x