But she isn't likely to agree that you paid her a compliment, is she?
Because I don't think most people wake up thinking that they look ugly or rough, and then do nothing about it. And she obviously isn't the rough type that might want to do that, because she's your friend, and therefore I presume she's nice.
So she probably will take it more like an insult than a compliment, even if you didn't intend it so.
What I do think is that you were probably taught as a child to "match" people to celebrities to help you remember them. I wouldn't do it out loud. I can imagine that it would annoy at least 50% of people, but it would be very difficult to tell you that it was annoying without ruining the friendship. Your current friends might not mind, or might be secretly hating it, but future friends might react like this lady did.
I mean, Rosemary might have nice eyes, but she's still not who you would want to be told that you looked like.
If OH came home from work and told me I looked like Rosemary Shrager, I'd launch something in his direction, and then tell him he looked like...I don't know...Alex Reid, or Christopher Biggins or some such. It'd be an insult, albiet a veiled one, rather than a compliment.