I had to laugh when my sister asked me if HE would be too stressful for my personality (I used to have mental health problems)
I know it's not easy, but how on earth could HE be more stressful than getting two children up, fed and dressed and dragging them up the hill to school for 9, then being in the house by myself (I work from home) all day, then having to be at the school gate (which I hear is a nightmare) at 3pm, not knowing what the kids have been up to and what mood they will be in, then having to get grumpy and tired children home, fed, maybe to an afterschool activity, do some reading, fret about reading levels or whatever, bathed and bed.
Where is the time for just "being" with the children in that day? Then if you want to go to a museum or something you can only go at the weekend, when the world and his wife (and kids) are all there too and you only have two days to do it in so you can't leave it if they aren't in the mood so you all get short tempered with each other.
Then you have all the worry of what if your child is being bullied by children or teachers, what if they have SEN-do you push for a diagnosis and risk singling them out? What about lunchtime-does the school have strange rules about packed lunches? Then there is uniform to buy and get ready, school trips to pay for where your child will spend a good proportion of the day being lined up and not exploring and anyway is limited to school hours.
Then what about the teacher- do you point out when they make spelling mistakes? How do you know they aren't telling your child creationist stuff (or whatever you don't agree with- I went to a secular school and several teachers taught evolution as a "theory" that didn't have as much evidence as creation and I had friends who were told they would go to hell if they were gay). I know lots of good teachers, but I also know quite a few with no general knowledge and a terrible attitude- what if one of those was teaching my child?
What about all the testing? How do you react if your child doesn't get the level they are meant to? what about if they are higher ability? What about if they are higher ability in one area but lower in another?
I take my hat off to people who send their kids to school- I just don't have the personality for it!
(Tongue in cheek, btw, but you get the picture- HE seems hard because you are used to school. They both have pros and cons, but HE families aren't perfect or saintly.)