Why are you hesitating from having the conversation that starts with 'sorry, this isn't working for me' and explain what needs to happen.
Where is the weight of expectation coming from that makes you carry this heavy burden?
My advice is to work out what is making you martyr yourself like this ... and just stop.
Put down the burden however works for you. Ask him to leave, ask him to make meals for both of you next week, ask him to get fed elsewhere.
Whatever works for you. Of course, it is not reasonable for a house guest to not make themselves agreeable and useful. In an ideal world you would not have to ask for this but the world is not ideal.
Please speak up for yourself. You will feel so much better for having taking control in this part of your life. If anyone outside yourself objects, that's really nothing to do with you.
The more you stand up for yourself, the easier life shall be for you. You don't need to be aggressive about it, just start from the position that he wants to be reasonable and tell him what you need to have happen. You really have all the power here.
All the best.