I've just realised my husband is late 50s but to my mind Silver Fox is older than DH. When I first saw him (SF), I definitely didn't think "only 5 years older than me". So I'm suspicious, too, now.
I thought as you get older, "old people" start to look younger. So seeing a 60yo when you're 20 makes them look older than 60 to you, but seeing a 60yo when you're 45 makes them start to look younger than their age. The fact Silver Fox feels closer to my parents in age, despite an apparent 5-yr gap between me and him, says a lot.