You need to weigh up what your life would look like if you were working.
Cost of working Vs earning potential - by the time you factor in childcare costs, travel to work, and clothes for work (depending on what you need), how much better off will you be financially?
Stress levels - if you have anxiety, it may be helped by having a regular routine and a job you like. On the other hand, you may be more stressed with juggling more things, and your DH will also have to step up more as you won't have the time the kids are at school to do housework in peace etc. Can you get more help with the anxiety?
Debt levels - are you accruing interest on the debt? How much difference would it make to wait a year until the baby is maybe weaned and it would be easier to leave him/her?
Could you look into working from home doing something in the evenings? Ironing or something? You'd need to get insurance etc, but that wouldn't be too complicated.
You've said you could easily cut back on your food spending - why aren't you doing that already? And changing utility suppliers is also a fairly easy "win" which doesn't involve any lifestyle change.
I would start by implementing your budget, while having a look for jobs - you may find that you see something you'd love to do, or you may discover that there's nothing out there that's going to make you better off.
I think it's a good idea to keep an open mind and explore all the options.