Yes I would, and I would also say the times you woke up to him doing this were rape too, because I came to the same conclusion when someone else disclosed that ‘just’ the sleep bit was happening to them.
Marital rape is still a crime, and without meaning to be glib it is one where you would be hard pressed to find victims who have not had consensual sex with the perpetrator, yes even after the offence(s) if they stayed in that situation.
Whether he knew you were feeling particularly vulnerable or not last night (and he knows PinkPoet) he knew you had said you were physically sore and needed a break - that you were warning him you didn’t want sex - and he ignored that.
I think what he did last night was quite high risk from his point of view given the current situation between you, and he’s completely aware of that. He has sought to gaslight you and control the narrative about it all day for that reason.
I don’t think him not understanding or realising how you feel comes into it. I don’t think he cares about your feelings outside of how they impact him.