You're right, kids do not give a toss about whether their parents love one another, so long as they are not screaming at and abusing one another. They just want peace and stability. Absolutely.
Historically, most children have not seen what we consider loving behaviour from today's perspective. It's the exception that we live in such incredibly fortunate times - historically and globally speaking - that this is even a consideration for anyone. Up until very recently, kids were generally lucky if their parents weren't actively abusive and tried to help them get through childhood.
That doesn't mean anyone should have to live in a loveless marriage if it is making them miserable, but it needs to be accepted as reality and taken into account, for sure. So anyway, you are correct.
And you are also correct that they WILL blame you for removing their peace and stability if you do. That's just reality. How long they will blame you for, or how that will turn out is anybody's guess.
However, if you are in a sexless marriage, there's a good chance your husband is looking elsewhere for sex, so it might not be a low conflict marriage forever. Even if you are ok with that, men who cheat (and many men in a no sex marriage would) are easily persuaded to dump their families. After all, many men cheat, and dump their families, even when they are in a loving marriage with a decent sex life.
Men are by far the more selfish of the sex. Just because things are good for your kids, don't assume your husband will care enough about their safety and stability to leave the status quo standing, if he decides his personal wants are not being met.
And you would be well advised to have finances stashed away and a back up plan for that happening. Sex binds a couple together, love and affection too. You are in a partnership, and men are selfish even when they receive love and affection.
And if that time comes, don't be persuaded to pretend that he is a great man and you're just not together anymore to try to spare your kids.
DO tell them, if and when that happens, what he did, calmly and rationally. Obviously, not using them for therapy or whatever - but just tell the simple truth.
If he cheats and/or dumps you all, do explain that it is HIS doing that you are not together. I've seen too many women take the hit for men's crap behaviour to protect their kids and end up with the blame themselves for things they didn't do, and with their kids resenting them when it was the man's doing. It also sets kids up for higher expectations of good behaviour from the man than they can reasonably expect - and that can be heartbreaking.
Not to mention it's really confusing for kids, they just don't get it when suddenly their parents are no longer together for absolutely no perceivable reason.
Anyway, I digress. Your instincts are correct. Kids want stability and peace and safety. That's their meat and drink. Love and all the rest between parents is just dessert.