Goodness OP all the abuser sympathisers are out tonight! You're doing nothing wrong, except trying to appease him. Although that's understandable. It's impossible though, he'll never be happy. It's not your fault he cheated. It's not your fault the marriage failed. Any marriage to an abusive person is going to fail, the alternative is to remain in it being abused!
He stays, is abusive, has family over etc to try to drive you out. There's nothing confusing about it, he's deliberately being a knob to get rid of you. He previously threatened divorce as a control tactic to get you to back down and do whatever he wanted. Even now he probably doesn't think it'll happen and could well be waiting for you to back down and agree to stay married but with a whole new level of shite to put up with now that he's stopped pretending to be nice.
The house will likely need to be sold. You don't have to do repairs etc it can be sold as is. If he wants to stay he'll have to buy out your share. If you want to stay you'll have to buy out his share. Doesn't matter who paid for it, it's a marital asset to be split between you.
Talk to Women's Aid and formulate a plan for how to safely exit this marriage, talk to solicitors too. This isn't going to be an amicable divorce no matter what you do. He isn't an amicable person. You're probably going to have to go to court at some point to force things along.
He thinks you're hiding money because he's judging you by his own standards and he is hiding money.
He doesn't want you spending your inheritance because he wants to claim half of it in the divorce. It's yours and you can spend it on whatever you like while you're married, you don't have to give him access to it apart from as part of the financial settlement in the divorce. If there's nothing left, he'll get half of nothing then! You don't have to tell him what you're spending, when, or on what. You're no longer a partnership and he has no rights to know. I am not a financial advisor, but my opinion is you may as well spend the inheritance now while you can, otherwise he'll nab half of it. Speak to your solicitor about it. If you don't know where he's hiding money and can't prove it, you won't get any of his savings.
He is the one dragging out the divorce not you. He doesn't want divorce because he wants the whole house to himself and if you move out that's what he'll get, he'll drag his heels forever to avoid selling the house and splitting the equity with you. So stay put.
It doesn't matter that he's pushing you to do things, you don't have to do them. If you're exhausted from it all and don't even want to do the basic cleaning you don't have to. He isn't the boss of you. Anyone in an abusive relationship is going to be bloody knackered. Running on adrenaline 24/7 because you're constantly afraid, is exhausting. You don't have to decorate or stay up late, you don't have to meet his standards on anything at all. The relationship is over - physically, mentally, emotionally, time-wise and in terms of support: you owe him nothing, nothing at all. Your life is your own, your time and energy is your own, he has no claim on it. The court will decide the financial settlement and what you're each owed monitarily.
If he has power of attorney over your affairs revoke it immediately and yes change your will too. These are priority, not painting walls and cooking his dinner! You need to start looking after yourself. Stop expecting him to be reasonable, stop expecting answers to anything, stop caring what his opinion is on anything and top trying to appease him.
If he gets violent or threatens you, call the police, every time. The abuse is likely to get worse when you start living life for yourself, standing up for yourself and he realises he can't bully you emotionally any more.
If I was you tomorrow I'd:
1 - revoke power of attorney
2 - call women's aid
3 - make appointment with solicitor about changing your will
In that order.