This is a decision only you can make in discussion with your DP.
Individual posters will have their own story as to what’s worked for them, but the important thing is what works best for your family, not just now, but in the medium and longer term too.
Personally I can identify to an extent with your emotions... i had to return to work when my first was 12 weeks (albeit working only 3 days a week) as this was back in the day of short ML and we couldn’t have lived off one salary then (sky high mortgage interest rates)
If someone had waved a magic wand the week before i returned and said our mortgage would be paid and I didn’t need to go to work, I’d have probably jumped at it- after all, it’s physically knackering to return to work with a breastfeeding 3 months old.
However being back at work is not like the thought of being back. I quickly realised dd was fine with her childminder, I was keeping my hand in with my career and it also meant a better balance between dh and me. In fact, I realised the benefits so much that I continued working after dc2 and 3, by which time interest rates had fallen, we could have lived comfortably on one salary - and in fact all my earnings went on childcare anyway! But dc 2 and 3 were at a brilliant nursery, we all benefited as a family and importantly i never stepped completely out of the workplace so never had the stress of wanting to get back in but finding it tough.
So i see the dilemma because to an extent you need to project into the future and consider the longer term implications of whatever decision you come to. And make sure it’s a joint decision too. I absolutely would not want the pressure of being sole earner so why would I put that on my dh? And likewise he considered himself an equal parent so has always done loads with the kids and in the home
Maybe requesting flexible working would be a step forward because you’re not completely giving up your career but you’re retaining a good balance. And if it’s the job you dislike, why not look for something new, because it’s much easier to get a job from a position of employment rather than trying to get back into the workplace after a long period out of it
Good luck