Sorry, OP, but you’re being very unreasonable here
I think this is really invalidating to you, OP. Feelings aren't meant to be 'reasonable', and you are not 'being' your feelings; you're being kind, civil, friendly, etc, to someone you find you want to be kind, civil and friendly to.
Feelings change according to stimulus, not decision. If he's giving you nothing to feel affectionate towards, then you won't feel affectionate. You can't force yourself to feel affectionate towards someone who is trying and missing the mark (as he clearly is), any more than any of us can force ourselves to, for example, like someone who tries to get us to like them by doing things we don't enjoy (like continually asking how we are, or continually bringing us gifts.
He wants you to feel affection towards him. You want you to feel affection towards him. What would make you feel that? What could he do right now that would make you think 'Aw, what a sweetheart'? Work it out. And then tell him.