Possibly. I've tried googling it can't find the actual research, but this kind of supports both your points and mine...
"Preference for sweet foods
One of the contributory factors that makes change to a less energy dense diet difficult is our innate preference for sweet foods. This is already present at birth, and persists through childhood (often beyond). In contrast to adults, children do not find that a food can be too sweet, and, given a choice, will choose the most intensely sweet food available.1 This tendency for sweet food can be seen as adaptive in our history when food was scarce, particularly for
young children requiring energy to grow. Reassuringly this preference for sweet can be modified by experience. Research shows that babies who are given sweetened water from birth prefer it more at 6 months than those who have only been given water.By preschool age children given sweetened, salty or plain tofu, prefer the version with which they are familiar, and do not automatically opt for the sweet variety. These studies provide some optimism that exposing
young children to less energy dense foods may help to modify a preference for sweet flavours."
This is from the National Obesity Observatory. But in the initial study, when they went back to see what these children ate as adults, there were strong correlations to what they ate at 3, but not in older childhood. (ie, as children they tended to eat / prefer more of those foods, but then reverted back in adulthood).
Anyway, I can't debate it with you because I don't have the research. But quick googling does show that whilst babies do have an innate likeness of sugary foods, infant diets can increase / decrease that. There seems to be a lot of info on this online - just google and I found loads of studies came up!