Having been in a similar situation I think you are doing well asking MN for advice at this stage. It took me at least a year after my relationship ended to ask MN if I'd been abused. Up until that point I thought they were rows that had got out of hand.
What I see now with hindsight is that he was never going to stop. Also I learnt that violence isn't always a punch. Infact the threat without actual contact us abuse too.
Like you I'm no wall flower and he always said I was argumentative. Also, the first time he hurt me physically he cried. It wasn't until the third time he stopped worrying about any show of guilt.
Also, like you most of it was pushing and grabbing of the arms. But he also threw things at me, occasionally k kicked out or pushed furniture into me. Eventually he had his hands around my throat.
Also like you violence didn't scare me like you would imagine it would, instead it just really hurt me emotionally because I believed deep down I had caused it and deserved it. I asked him to leave when he threatened to kill me and our child in our beds. It was only the threat against my child that made me finish it.
What I thought each time was that he would not do it again because I would try not to piss him off,as I wrongly believed I was causing it. Wrong.
Men who get physical do it for one reason only. To make you back down and bend to their will. It is a tactic of control.
I wonder what you argue about. I think these rows are part of the abuse. Maybe he wants to get his way, the verbal bashing doesn't work, he then ups the anti and pushed you around to get his way. This is him and it won't stop. Now he has humiliated you by showing you he could kill you if he do wanted he has tested your limit. If you carry on with him now he has learnt that even this is not enough for you to tell him to leave and he will most certainly do it again.
Basically, his brain is wired differently and he'll use whatever tactic he can to control you. Be it a row or a push or holding your throat.
You have only one option to get your esteem back on track. You need to finish it with him. It's a very dangerous time so please tell your family what you can and perhaps stay with someone for a while.
Remember he must be totally responsible for his own actions and that none of this had been caused by you.