Because the baby is not on the train with them, it is being assumed they didn't take him on their latest holiday. How would anyone know if the baby was left in Kensington or if the baby travelled back to London in a car?