Hi, I want to knit a jumper with worsted weight wool. The pattern says to use size 4.5mm needles. As luck would have it, I have about 4 pairs of size 4mm and some 5mm but no 4.5mm. Will I ruin the jumper if I use the size 5? Thanks.