We've had our plum tree for 7 years so I was delighted to spot hundreds of tiny green plums this year. However as they've grown they are all turning brown and scaley on patches. Do I need to spray it or something? I can't see any bugs other than wasps around it.