The steps were codified with male and female dancers in mind, so it's hardly surprising.
I can dance with men or ladies of pretty much any height, but some will be more comfortable than others.
Because men usually have higher torso:leg ratio than girls, (and girls wear heels), ballroom with a man about 6" taller than me is usually the best. With a girl, she'd be about the same height.
Of course then you get aesthetic differences because you lose the difference in height at the top of your partnership so your frame looks a bit different, and you have each other's boobs to contend with. 
If you're dancing both ballroom and Latin, with a girl who is a good hip height match and the same height as you, your Latin style probably changes, because it's harder to turn somebody under your arm than if they're shorter. So you do more side-by-side work, and less underarm turn and clear lead/follow work.