I'm sorry OP, but to me this is sexual assault. I think you're not quite sure how you feel right now because you're in shock. You might feel confused or vulnerable or upset too, or just numb.
He knows he's stronger than you, he knows he'll always win during this 'play' fighting. It's really play flighting is it when it's not equal at all. It's more like treating you like you're a toy, a plaything and getting high off his own power.
Abusive men will often start with play fighting. It will be a woman who's in a pillow fight where she's slapped across the face (with the pillow because that makes it fine apparently), or it will be the man pinning the woman down for 'fun' and tickling her until she wants to wet herself. It's a way for them to test boundaries.
He's apparently forgotten it already has he?? Oh no he fucking hasn't OP No man forgets something like that. Being clawed at like that for doing something sexual is a visceral experience that is going to stick in his head. He's just pretending he's forgotten and moved on hoping you will too, hoping you will accept this abuse as a normal part of your relationship.
Even if this abuse were just a casual thing to him (as some people have a seriously warped sense of what's normal), that doesn't mean you have to accept it! And it doesn't mean it's good, healthy or acceptable!! People who were brought up in cults might think of certain things as normal, but would you put yourself in a vulnerable position around them just because they think certain things are acceptable?? I don't think so, because your boundries would be where they should be, but here your boundaries have been warped.
I actually ended up clawing and pinching his face and refusing to let go until he’d moved his hand
It was bad enough that he carried on when you protested, but for you to have to resort to this?? You were not overreacting. He sexually assaulted you and he knows it. Now he's tested the waters I wonder how long it will take him to take it a step further.
You know what a lot, if not most abused women have in common? It's the fact they don't leave soon enough. For some reason, warning signals are ignored, often because of self-doubt caused by a bad background or a gaslighting partner, who insists they didn't do what they literally just did, insists their innocent (often convincingly) or are profusely apologetic (when it doesn't take long for them to repeat their unhealthy and damaging behaviour again).
Those women stay for longer than they should because the doubt their own minds or because they hope their partner will change, and then one day, the abuse escalates until they ask themselves 'how on earth did I end up in this situation?'
I believe that you are at the point now that is crucial. If you don't leave, I except worse things to happen to you.
Gather your dignity, pride and leave for a safer, more respectful relationship.