It sounds like your relationship is at it's close, which is fine it's not a failing on either of your parts. You wouldn't be posting on here if you didn't have doubts. I would say trust your gut.
You're not married, you don't have kids (or that's how it reads? Please correct me if not), and you have your own places to live. That makes life really simple.
The nest bit, breaking up, is hard. I think, based on his 'throwing his toys out of the pram' you need to take the lead here, state your position clearly and directly and then stick with that. No breaks, no time to think. Just I'm sorry but this isn't working for me, I wish you all the best.
It's going to be hard, 2 years is no short amount of time, but if things continue any longer anger and resentment will build up, and that'ss a ticking time bomb.
Wishing you all the best and good luck.