Apparently all our financial problems are my fault, I've never loved him and he cant take my abuse any longer
It is so easy to let your partner, who you trust, get away with financial abuse for so long. He is incompetent with money and encouraged you to give up a good job. You had a choice years ago, either to take 100% control of all family finances, including his paycheck, or to be independent financially and leave.
Have you spoken to anyone in RL about this. That is the first thing I would do. Secrets are damaging. Get some support for yourself.
Second, call his bluff and let him go. Either he no longer loves you, or is playing control games. Don't beg him to stay.
Get yourself a good, full time job. Being independent will be good for you.
Get on and rebuild your life. Either he will come back with his tail between his legs and you can start working on how to fix your relationship, including him not having direct access to money and credit. Or he will leave, either way it puts you in a more confident and stronger position, and allows you to get some self-respect back.
Start making financial decisions yourself. I know that when you are not the breadwinner that is hard, but you may find that you are way more savvy money wise than him.