And if you were happy and not trying to pick fights, and just not fancying him, that would be one thing, but this is another.
Do you not have sex at all with him? I do find that having sex makes one (particularly women) want to have more sex.
Do you feel attractive, generally?