Honestly, I think arguing in a relationship is quite normal and healthy. No relationship is argument or disagreement free. However, what is important is what those arguments are about, why they happen, how often it happens and how you resolve it.
If I was having the same argument with someone, as you appear to be having, every few weeks then I would walk away.
Something will start it off, usually me feeling like he’s not being as romantic or affectionate, or that he seems off. I’ll bring it up, he’ll get defensive and angry, feel criticised, and it will blow up until he leaves. We then have text wars for a few days before eventually reconciling.
Personally, I would find someone wanting more romance or affection from me incredibly tedious and demanding and it would make me defensive and angry. Not everyone is wired to be outwardly affection (for some people, it actually gives us a massive ick if people are like that or want that).
It's not in my nature (as it isn't in many peoples) to turn ourselves into something or someone we're not (i.e. being overly romantic) to please someone else. That sort of stuff shouldn't be forced in a relationship, you should be able to exist naturally and both of you being happy with how you interact and show appreciation and love without one of you expecting or demanding more from the other. Your relationship is not how a happy, healthy, relationship works.
If you have to repeatedly seek reassurance from someone that they care about you, or because you want more romance from them, then the relationship is not right for you. And if they are not able to give you what you need, or you're not able to compromise and accept actually this is 'them' and they do care about you - they just don't have to announce it every five minutes - then you're not the right fit for them and they're no right for you.
Honestly, it all sounds very hard work for two years in.