Yes, there are many men who would have married the 'homely' neighbour in order to join land or for alliance reasons.
But very often, a wealthy man 'gets to pick' a beautiful woman. Over several generations, surely this results in a better looking family overall. Whereas we plebs occasionally are randomly good looking, but not in the same way as a family with generation after generation of 'beauty injections' to their gene pool.