Puberty supercharges the male physiology but the male athletic performance advantage exists from birth, it's just less dramatic. Prepubescent boys significantly outperform girls across a range of performance indicators like jumping, leaping, speed etc, with the exception of balance and flexibility, which girls are better at.
Males with a DSD which prevents them from benefiting from puberty, or boys who have had puberty blockers look more like women. But they are all male and dominate sports they are in.