That's short term thinking. And yes, you'd probably be worse off in the short term by continuing to work.
But you need to think long term. By continuing to work, even if you're slightly worse off, then you're keeping yourself in the workplace, keeping abreast of new developments, training, development, potentially promotions, etc. You're also still contributing to your workplace/occupational pension, to which your employer is also likely to be contributing significant amounts.
So, you're going to be in a "better place" in a few years time when your kids are in school. If you leave, then you risk losing key skills/abilities, may have to take lower paid/lower prospects jobs to get back into the workplace. Your pension would also have suffered a few years of not having employer contributions paid into yet - yes, invisible in the short term, but could make a big difference when you come to retirement to have a few years of extra employer contributions or years of working taken into account for final salary schemes based on years worked.
You really have to think longer term, think carefully about what kind of job you'd expect to return to in x number of years time, whether you'd get a foot in the door to continue your career or whether doors would be closed and you'd end up in long term low paid/low prospects work, etc.