At breakfast, I kept the milk feed before the solids for quite a while - until they were quite big toddlers. In another couple of months, you will be able to switch to a sippy cup, so it actually quite easy.
All the other meals at usual times, and you move towards water with meals. Milk feeds switch to "snack" times ie mid morning, mid afternoon, and bedtime.
My youngest starts school next week, and still likes milk first thing, mid afternoon, and before bed.