I'm sure it must depend on the family - on how hard it is to get your kids to school and whether they are stressed as a result of going, on what style of home ed you want to do, on how demanding your kids are when they are at home, etc.
My older dd only tried school for a while in Y5. School wasn't awful, but I certainly found it harder than home ed. The main issue was that everything to do with school was so completely inflexible, and you can't just say "oh well I won't bother about that today" as I often do with HE!
It took a lot of time/energy/organisation to make sure my dd had the right gear with her. If she didn't have a clean uniform then she couldn't just go in something else. If we misplaced the school notebook, she couldn't just take a different one. If her black shoes were too small or too muddy or missing, I couldn't just send her in her other shoes. If I hadn't made sure to send her with a warm enough coat, she couldn't just give playtime a miss for that day and stay indoors. Having signed up to school dinners, it was essential to set aside dinner money every week (and remember to bring it on the day!) and I couldn't just send a packed lunch instead if we were a bit short of cash.
Because I'd chosen not to send her to the nearest school and there was no good bus route, I always had to be concerned about whether the car would start, and I needed backup plans in place in case it didn't. (In fact we have two ropey old cars and dh has always taken mine to work if his wouldn't go. So I would also be in a pickle if his car was ever out of action! During dd's school days he ended up missing a few days of work because of the necessity of sorting the cars out promptly.) I used a lot of mental energy ensuring there was no risk of me getting delayed and failing to collect dd on time, meaning we couldn't do much of anything after 2pm. It was particularly hard to schedule her little sister's hospital appointments - you know how those can drag on!! I swapped phone numbers with some other parents so I'd have someone to collect dd1 in an emergency... but still I had to make sure I actually had their numbers with me on the day.
Now, these are all little things. None of them was a deal-breaker. But the cumulative effect was pretty big for me. It wasn't just the time and effort, it was the worry about getting all the details right. School felt like a big commitment.
...oh, and I also felt under pressure to schedule quality time with dd1 when she wasn't at school, because I wasn't spending enough time with her for "quality time" to just happen naturally on its own at some stage. With HE, I have no hesitation in telling the kids I am too busy at the moment. They get plenty of attention overall. If they have some issue they want to talk to me about, or they want to read with me or play with me or whatever, it'll happen. I won't usually drop everything at 5pm when I am trying to get dinner on the table and the little one to bed, but it'll happen some time pretty soon.