This is our set up but I also work 30 hours over 5 days a week (DH works 6.5 days a week). We both have high stress, reasonably risky jobs. I do everything in the house/for school/children etc except the bins, on top of that I do all the paperwork/accounts and admin for his self employed business.
I need decompression time from all that but luckily he thrives on spending time with the children during the hours he isn't working and has no desire to socialise away from them. Everyone has different needs.
A lot depends on the age of the children - now mine are well into primary school I have a bit more time on my two 'half days' off work while they are in school. I go for a swim, have a nice quiet lunches by myself, do errands at a leisurely pace, do a few hours of my crafty hobby, get my hair cut or just drink hot coffee in peace.
It means I'm a better less snappy mum the rest of the time because my emotional needs are being met as well.
On top of that I go out once or twice a week to a hobby with friends during the winter months.
I feel zero guilt. Zero, my children are perfectly happy and healthy and it does them and their father the world of good to not have 'mum' running round after them all the time. I feel like a whole person again and not 'just mum'.
We also have a cleaner for a few hours once a week - I do far more than my fair share of the cleaning and housework because of DH's work so I consider this as his proxy contribution.
Is anyone making you feel guilty or is this something you are doing to yourself?