It's not really horrible - it's a result of common sense, viz, that if he was sexually attracted to my body when I was 21, firm, slim (thought I was fat of course as all 21 year olds do), with good clear skin and a very high sex drive, it doesn't make sense that he would be attracted to my overweight, achy, flabby, tired body which is frankly more often than not not in the mood.
As I say for me, physical desire isn't the be all and end all in a committed relationship. If he'd put on about 4 stone in the time we've been together, or gone bald, it wouldn't have bothered me (as it is he's still incredibly slim and youthful, must have some portrait in the attic rotting visibly :P). When we got together he had long lovely hair, which is one of my big ticks for finding a man sexy. He's cut it off now. Doesn't matter. Because I don't expect to be all fizzing with horniness 15 years into the relationship with two small kids to look after. Call me unambitious if you will.
He doesn't say or do anything to make me feel like he doesn't like my body, quite the opposite. I know he wants to have sex with me, because he wants to have sex, with me. That doesn't mean he find my body, as it currently is, attractive, and it would be ridiculous to suppose he did really. If that was his type, he'd have never got together with 21 year old me!