Unpaid work has value in it, it can have more value than paid work in many cases. And there are lots of worthwhile things a person who is not in paid employment can do for the community, their family, themselves.
On the money side, it sounds like you are in a position to do this to me. But I would sit down and run the numbers, including what would happen if there was death or divorce. You have your pension If your dh died, and possibly some benefits as a widow? What about insurance, for example on your home - would that be paid off? Does he have a pension that would come to you? You might find that once you look at it, you could remain not working or only have to work part time if he dies, which is very doable.
In terms or a divorce, I'd just break it down in a similar way. See what you could put in place in case the worst happened. And you also have to make a judgement call, how likely is this, really. It's all very well to say you need to take every possibility into account, but that's not really possible and no one actually does it no matter what they claim, they look at the most likely scenarios. The chance of a divorce for you may not be the chance for the next door neighbour, so statistics aren't much help in this instance.
If you are leaving your job anyway, if you decide staying home isn't what you want, you can always find another job. And having had a break might mean you find some other direction to move in.