He won't 'agree' to you ending joint counselling to carry on in single counselling.
It's best to say to him, that none of this is working and that you are going to stop the counselling, and that you want to separate.
He will panic. This will spark a reaction in him, especially if he sees you mean it. Ride that tidal wave, focus on what is past it, which is calm, serenity and peace, know that on the other side it's better.
Stick to your guns. Tell him it's not working and perhaps it's time to realise that enough is enough. His treatment of you has sunk to such a depth that you are losing all last vestiges of respect for him, so it's better if you cut to the chase sooner rather than later or you will end up really hating him.
Or tell him that you feel that counselling is counter-productive, he's not taking it seriously, and actually it's making the issues worse, so there comes a time when you realise that the end has come, a line has been crossed, and you have reached that line.
If you need to be devious, Tell him that perhaps a break may help to calm you both, to give you the space to see what is what, and to mend a little and if enough progress has been made to resolve issues that there may be a way back, but that atm there are 2heads knocking at each other and it's destroying everything you have.
FYI only:
You are not setting 'Ground Rules' you are merely stating your boundaries. I'm willing to bet that they are very teeny weeny boundaries too. If you can give examples, I can show you how unbalanced they are in his favour, i guarantee it.
I know this because I got down to a single boundary (which Ex STILL didn't honour) my only request of him was 'Not to be so nasty' 
NOT:
To stop being nasty full stop.
NOT:
To be NICE
NOT:
To Actually respect me
NOT:
to treat me as an equal
JUST:
Not to be so nasty.
You are entitled to a space that is YOU. You are entitled to state preferences for how you like to be treated and you are entitled to people respecting those boundaries.
That is not being controlling. That is (I'm led to believe) how NORMAL people live.