Long time reader but first post as this really struck a chord with me. Easily could have been me writing this, almost word for word, this time last year. It took a LONG time for me to realise that my ex was an emotional abuser, controller and all round bad guy - he did all the things this guy did.
Everything is on HIS terms. That will never change. OP, it sounds like you want (or wanted) more from the relationship at some point. This will never manifest. He has to be in control. The accusing you of running hot/cold is also classic deflection behaviour. You probably feel like you're going crazy, right? I've been there.
He stomps all over your boundaries and is passive aggressive - that also will never change. He has you hanging, and knows how to push your buttons. Dangerous power balance. The threatening to leave stuff is horrible attention-seeking - he will never leave, but will always dangle that threat especially if he sees that it makes you anxious.
If you feel nervous around him, and that he has a cruel streak, then please get yourself out of this situation. I didn't feel scared of my ex but he was definitely secretive and could be cruel and rough in bed too.
You can escape this and you will get over him, it takes time and a LOT of resolve as these relationships can be very addictive. have a look at the Baggage Reclaim website and other resources that have been mentioned on this thread.
You deserve better. We all do, and (tentatively, hopefully) I think I've found it. It's refreshing and lovely to be in a relationship of equals - I'd forgotten that's how it's meant to be.
Good luck OP