Oh dear, a few 'red flags' there op
He apologises but
Any apology with a 'but' on the end of it is not an apology. He is blaming you for his actions. Actions which you have just told him are disrespectful to you.
says its because he loves me and wants ne sooo much. I then feel bad because he's trying to be nice and he loves me
Nope. It's not because he loves you, it's because he wants to have sex. End of. He can love you without having sex can't he. He is not being honest with you there. Just thinking about his own needs/wants again, no consideration as to what you need/want.
He has in the past stopped for a while after big talks but that can mean bot being affectionate at all as he doesn't trust himself not to grope me
Nope, not honest again. This is his way of punishing you, by withdrawing affection until you cave in to his demands.
he always seems to forget and start groping again
No he doesn't 'forget'. Does he usually forget things, does he have short term memory loss? No, he just wants to pressure you into having sex with him.
All of these actions are emotional blackmail. And they are working. If you have any hope of an equal, mutually satisfying sex life, he needs to be much more honest with you and will have to respect your wishes.
Couples counselling might do you both the world of good. I think it's more of a communication problem from what you've said.