Men have a larger liver, for a start, but their pelvic cavity is also differently shaped to the female pelvic cavity for the reason that the female pelvic cavity is designed to permit a pregnancy, and then to function as it should in childbirth.
That is why women have a different hip-waist ration to men, and part of the reason that female walk and gait is different to that of the male.