DD1 did look like dh's side. Less so as she grew up. She's now a mixture in looks but very dh in personality.
Dd2 is very much my side, there's a very distinctive look and way of moving which is my uncle/brother/mum's cousin.
This is so distinctive; I had only met my mum's cousin once or twice growing up, but as an adult I saw someone coming towards me and knew he had to be related because he was so like my uncle/brother. Turned out to be my mum's cousin, who was (as we were) visiting the area.
Facially she's like me, and always has been.
Ds is so like dh that both have them have been stopped in the street to ask if they are related to the other one. He's the spit except for hair colour. We have child photos which could be either one of them. He's more like my dad in personality though.
Thing is both me and dh were fair/blue-eyed as a child, so people could see what they wanted to.
However, I do get where the op is coming from. There were two points I can remember feeling irritated:
One was when dd1 was about 2yo. MIL stayed and literally everything was just like someone in her family. Yes, dd1 was alike, but not that distinctive. The point it hit exasperation point, was we were taking dd1 to the park. I put out my hand to take dd1's hand to cross the road and she put her hands behind her back, because she didn't want to hold hands.
"Oh... oh look. She's walking with her hands behind her back. X used to do that all the time."
"She's only done it because she didn't want to hold hands crossing the road."
"Y used to do that too..."
I mean, honestly. That was pushing it.
With dd2 she used to go on about her eyes. Apparently because they were blue that was her side of the family. She's actually got my dad's eyes, and he's got his dad's, most of her is mum's side of the family. They're a very bright blue, whereas dh's side are very grey-blue.
Apparently her eyes are like her mother/herself/my fil/one of dh's siblings/her cousin etc depending on the particular person she was thinking at the time.
Thing is she was so like my side of the family, that I think blue eyes were the only thing she could latch onto as like them.
What I have just realised, and my dc are adults now, and it hasn't occurred to me before, is that my side of the family has always acknowledged the likeness to dh's side, and never particularly commented on how alike dd2 is to me.
It's been mentioned very occasionally, but just in a "tall like her uncle" way rather than "sooooo like in every way....". They're far more likely to comment how like ds is to dh than how alike dd2 is to me, and when dd1 was a baby they commented that she was like dh.