OP, you are not a victim.
You say your instincts are all over the place. Well, they may be a little fuzzy but you can clearly still feel them and they have led you here. You also say that you couldn't quite "get" your dp. Again, nothing wrong with your instinct there, in view of the background details you've given us.
Like a lot of people on these boards you're starting to see a pattern to your relationships, so you now have instinct and insight.
You don't own a property with this man, you don't have children together, you're not married, you work and have your own home.
I know it is still very hard for you to think that you can leave him, but the above makes it easier in practical ways. Emotionally it seems like you're looking to give yourself permission to do so. Trying to weigh things up, balance things out, see what looks right and wrong.
You can leave him even if you can't write it all down on a piece of paper. It's his very behaviour that's making you feel confused and doubt yourself. You are clear headed enough now to be considering that what's happening is wrong. If you leave it too long you may lose that clarity.