Of course they matter
In our western culture there is definitely a demand for aesthetic symmetry and generally accepted standards of beauty can be observed.
Women: perky boobs, nice hair, nice ass, curves in right places, not too tall, make up etc.
Men: 6 foot tall plus, muscles, v-shape, good jawline etc.
I'm a guy with none of the above features, dating for me has always been dire, in fact in high school girls showed so little interest in me that I ended up discovering my bisexuality in order to get what I needed, I couldn't get it from the girls so I got it from the boys instead, where such standards didn't matter - they were so horny I only needed to be alive! This suited me as apart from the fact I didn't meet the visual criteria I also could not be arsed with the mind fuckery and drama of the girls. You have to play the game, right?
I'm in my 30s now and most women would still not care to look at me in a romantic way, I'm 5'6, skinny and I look very boyish. My personality is also quite feminine - I have good emotional intelligence but that doesn't matter a fuck it seems :/
It's really annoying to me, I consider myself very good looking but just not in the way women want, they just think I'm cute and want to mother me.
Can't win.