We are growing tomatoes in containers on our patio. They have some tomatoes on them and lots of flowers too. Should I be removing flowers now as I can't imagine them growing and ripening before it gets too cold.