Massive upheaval for you, the children and him.
But, you've done enough, and he hasn't, and it sounds cruel, but staying is not only cruel to yourself, your children, but also to him......
I know it may come over as a bit crass, but...
If you feed a starving man a fish a day, you'll have to feed him everyday of your life.
But if you teach him to fish, not only can he feed himself, he can help feed others.
AND it releases you from the cycle.
You've fed him every day since his stroke, it is now time to hand over the aspect and responsibility of learning to fish to someone else.
Wishing you great luck.