Wait until he says, 'why don't you wear things like X?' as my former H used to say to me, complaining about my clothes while sitting there in old jeans and a jumper he'd had since he was 18!
Either he doesn't think you are worth complimenting, or he takes you for granted so isn't really paying much attention, or he is doing it as subtle bullying to make you feel bad about yourself and undermine your self confidence. There is no need for him to go on about how attractive his ex partner was/is. I say subtle bullying, because it isn't an outright insult about how you look, so you wonder if you're just being silly. YANBU to be upset.
When he compliments what other women look like on the TV, you could say to him, 'you know, you're full of praise for everyone else but me these days, and I find it really hurtful. What is so different from when we first met? You said I was beautiful then.' But be prepared for him to say things you don't want to hear.
Do you compliment him, or isn't there much to compliment him on? From your post I think I'd struggle, he sounds a controlling bully. I suspect that telling you how beautiful you were was very flattering when you first got together, and part of his reeling in technique. Once he had you he stopped trying hard, and concentrated on keeping you, working on your failing confidence so that you won't be able to leave or have an affair. I hope I'm wrong, but if you didn't care what he thought you'd have told him where to go long since.