You are NOT annoying me... frustrating .. but not annoying.. ;)
Come on.. you cant carry on like this. It isnt doing you any good at all. If the relationship is not what you want, then you have to end it. Nobody has to live in some sort of limbo.
None of us know you in real life, so it is only what you have posted that we can advise on, and no matter which one of you is "in the wrong", you are not happy.. and as I have learnt in life, the only way to resolve that is for you to take control.
Do you want to sort things out, continue the relationship, improve the relationship, stay together and be happy together?, or do you really feel that you have reached the end of the road, and want to end it? Only you can decide that.
I am sorry if I sound harsh, and I really dont mean to be, but I have seen people spending years in shit relationships, and its a waste.. it really is. We only have one life, so why spend it miserable and unhappy and wishing it were different, but not doing anything to change it?