It is not right, having access to your accounts - however your situation may be recoverable? Only you can decide that.
Other than your accounts and finances. How do you really feel that your relationship is? Do you have fun, do you love each other, is there respect in other areas.
I’m just saying this as it may be easy to say ‘abuse abuse’ which must equal ‘end of relationship’. And it may be the case. However there are some people who are controlling not because they want to control you, but because of their own imperfect human issues, but that they do love you.
I am separating from my Ex and I’ll be honest, he’s been horrible to me really. He’s cheated. He also questioned every single transaction about money on his account - I had to use his account for most things as I became a SAHM for our DS with SN. Every package to the house, he queried and put down. At one point, he got me send him a break down of where all the money I was spending went and asked me not to use the cash point as we were short of money. Implication was - I was spending too much. Whereas he could spend whatever he wanted, do what he wanted, and I had no access to the account or his wage.
Like you OP, this is clearly wrong. And for me, alongside the cheating, I think it has amounted to emotional abuse.
If I were you I would definitely draw a boundary, all your account, your name, your access. He is not allowed to question or access them.
You don’t even have to justify.
However there are still two possible scenarios, that he is very, very worried about money and needs to learn to give you some trust. If this is the case, then maybe draw up an agreement - he doesn’t access your accounts but you to a certain extent take seriously what his worries are - agree to spend a certain amount on food for example - perhaps both agree a joint account where bills, food and joint expenses go and you both pay in an agreed amount dependent on your wages.
Or you see this as matching your gut feeling that this relationship is over. As is mine. Only you know. Only you decide.