I know you've had a real hard time on here @Lazym but I think people are really just trying to help you. You are clearly not happy with this man, and you don't want to work any more hours because is IS shit working full time - unless you really enjoy your job (which many don't.) But.... as many have said, if you want to get away from him, you need to have more income yourself. Gonna be hard to leave and support yourself with 2 kids though, and I think you know that, and surely others must realise it too. Many women find it hard alone, especially with children.
I worked full time for the first 12 years or so of my working life - then I dropped my hours after having two kids - went from 37.5 a week to 30 hours a week (4 days one week/3 days the next,) till they were about 5 and 6. I was still having 5 days work shoved on me though, and was constantly struggling at work and still having to do 80% of the stuff at home/life admin/childcare etc, as it was assumed I would do that, because I was the 'part time' worker, AND also the mum.
I also got the snide 'hello part timer' comments when I rocked up on the Tuesday on my 3 day week. Honestly some people are so vile to working mums. 
And then I left that job and dropped my hours to 18 in another job, when the kids were 5 and 6. The job was less pay and less hours but we needed no childcare by then, so it balanced out IYSWIM. One of the best decisions I ever made. Kids both left home about 10 years ago and I still work just 21-22 hours a week now (over 2-3 days, work from home,) and I honestly do not know how I used to do everything when I worked full time especially with two kids and elderly parents, when I worked 30 hours a week. I do remember I was very stressed, I didn't have much time to myself, I didn't really have any hobbies, I didn't see my friends that much maybe once a month, and seemed to be constantly chasing my tail.
Dropping my hours was the best. I had so much more free time, especially when the kids were at school. It was also lovely when they were off on school hols though, and I had time to do stuff with them/go places/go on day trips etc.
I have a lot more free time to myself now only working 21-22 hours now (from home,) over two and a half days/three days, and having no children at home I have time to go for walks, to play badminton, to go swimming, to just sit in the garden reading, to spend a bit of time on and here go on Twitter and Facebook, (And mumsnet!) walk around The Woodlands and the beach taking photographs, and just going on day trips with DH, my friend, my DC, or catch up with friends over a coffee or pub lunch.
Yes I could work a full time but I don't want to and I don't need to... I'm nearly 60 and I worked full time for about 12 years I still worked 30 hours a week for a further six or seven years - AND I've carried on working part time since. I've never not worked in almost 45 years, and I've always paid my way - never claimed any kind of benefits not - that there's anything wrong with doing that if you need to! We have got no mortgage now and I can afford to work part time and for DH to only work 30 hours a week too. Not apologising to anybody else for it or explaining myself.
Anyway tl;dr what I'm trying to say is you don't need to feel guilty for working part time at all and wanting a lot more time to yourself. IMO people give you crap for it because some people (not all,) are a bit jealous and bitter because they've got to work full time because they can't afford not to. Then again if you really do want to leave this man you are going to have to up your income so you can afford to live on your own ... with your kids!
Then again do you really want to leave when you're financially fairly comfortable and secure at the moment and your kids are comfortable and you like being part time... ??? It's quite the dilemma - and it's a dilemma that many many women have .. Whether people admit it or not, a lot of women do stick with their partner because are better off financially (and they also stay for the kids...)